-- Logs begin at Wed 2022-01-19 15:05:59 UTC, end at Wed 2022-01-19 16:23:38 UTC. -- Jan 19 15:53:25.355192 dv-cinder-820027-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 19 15:53:25.364901 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 19 15:53:25.366860 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jan 19 15:53:25 2022] *** Jan 19 15:53:25.366860 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 19 15:53:25.366860 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 19 15:53:25.366860 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: nodename: dv-cinder-820027-5-iscsi Jan 19 15:53:25.366860 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: machine: x86_64 Jan 19 15:53:25.366860 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: clock source: unix Jan 19 15:53:25.366860 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: pcre jit disabled Jan 19 15:53:25.366860 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: detected number of CPU cores: 4 Jan 19 15:53:25.366860 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: current working directory: / Jan 19 15:53:25.366860 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: detected binary path: /usr/bin/uwsgi-core Jan 19 15:53:25.367609 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: your processes number limit is 47680 Jan 19 15:53:25.367609 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: your memory page size is 4096 bytes Jan 19 15:53:25.367609 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: detected max file descriptor number: 2048 Jan 19 15:53:25.367609 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: lock engine: pthread robust mutexes Jan 19 15:53:25.367609 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: thunder lock: enabled Jan 19 15:53:25.367609 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 19 15:53:25.367609 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 19 15:53:25.412301 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: Python main interpreter initialized at 0x55cb261889c0 Jan 19 15:53:25.412301 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: python threads support enabled Jan 19 15:53:25.412301 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: your server socket listen backlog is limited to 100 connections Jan 19 15:53:25.412301 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: your mercy for graceful operations on workers is 90 seconds Jan 19 15:53:25.412721 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: mapped 403077 bytes (393 KB) for 2 cores Jan 19 15:53:25.412721 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: *** Operational MODE: preforking *** Jan 19 15:53:25.412983 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: *** uWSGI is running in multiple interpreter mode *** Jan 19 15:53:25.412983 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: spawned uWSGI master process (pid: 114010) Jan 19 15:53:25.413194 dv-cinder-820027-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 19 15:53:25.413982 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: spawned uWSGI worker 1 (pid: 114011, cores: 1) Jan 19 15:53:25.414088 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: spawned uWSGI worker 2 (pid: 114012, cores: 1) Jan 19 15:53:25.415459 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 19 15:53:27.196561 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 15:53:27.196561 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: from cryptography.utils import int_from_bytes Jan 19 15:53:27.197259 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 15:53:27.197259 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: from cryptography.utils import int_from_bytes Jan 19 15:53:27.197259 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 15:53:27.197259 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: from cryptography.utils import int_from_bytes Jan 19 15:53:27.197800 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 15:53:27.197800 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: from cryptography.utils import int_from_bytes Jan 19 15:53:29.791666 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 19 15:53:29.792274 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 19 15:53:29.792430 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 19 15:53:29.792628 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 19 15:53:29.793001 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 19 15:53:29.793080 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 19 15:53:29.793080 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 19 15:53:29.793236 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 19 15:53:29.793412 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.793552 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 19 15:53:29.793736 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.793821 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 19 15:53:29.794055 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.794183 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.794369 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.794514 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.794695 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.794837 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.795026 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.795187 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.795350 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.795521 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.795667 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.795835 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.795993 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.796161 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.796251 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.796482 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.796582 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.796813 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.796902 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-5-iscsi {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.797649 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.797890 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.798018 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.798202 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.798571 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-5-iscsi {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.798771 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.798921 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.799113 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.799198 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.799419 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.799504 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.799740 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.799822 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.800059 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.800168 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.800400 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.800557 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.800711 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.800992 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.801224 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.801347 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.801538 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.801637 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.801846 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.801937 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.802159 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.802331 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.802496 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.802584 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.802812 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.802900 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.803152 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.803284 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.803462 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.803588 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.803767 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.803849 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.804092 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.804177 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-5-iscsi {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.804404 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.804490 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.804778 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.804866 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-5-iscsi {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.805090 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.805182 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.805412 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.805493 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.805729 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.805812 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.806097 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.806240 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.806417 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.806508 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.806737 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.806832 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.807064 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.807153 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.807391 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.807474 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.807708 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.807803 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.808032 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.808147 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.808344 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.808439 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.808645 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.808738 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.808952 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.809056 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.809259 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.809343 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.809569 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.809673 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.809874 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.809970 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.810178 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.810269 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.810429 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.810526 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.810785 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.810869 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.811062 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.811164 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.811378 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.811464 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.811704 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.811794 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.811988 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.812081 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.812302 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.812398 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.812576 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.812700 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.812849 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.812941 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.813171 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.813301 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.813495 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.813582 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.813799 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.813888 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.814105 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.814194 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.814410 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.814498 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.814716 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.814800 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.815039 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.815138 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.815349 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.815440 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.815658 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.815743 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.815966 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.816055 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.816283 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.816373 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.816591 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.816682 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.816909 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.816993 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.817217 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.817312 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.817539 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.817621 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.817843 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.817931 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.818178 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.818278 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.818491 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.818574 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.818796 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.818881 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.819138 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.819227 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.819458 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.819542 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.819766 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.819856 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.820076 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.820179 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.820379 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.820461 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.820700 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.820785 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.820996 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.821081 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.821306 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.821388 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.821555 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.821645 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.821858 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.821943 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.822163 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.822247 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.822467 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.822568 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.822771 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.822862 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.823096 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.823185 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.823401 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.823502 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.823700 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.823784 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.824007 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.824091 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.824310 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.824400 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.824614 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.824698 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.824918 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.825007 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.825221 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.825312 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.825524 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.825614 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.825830 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.825911 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.826132 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.826225 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.826434 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.826524 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.826739 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.826820 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.827066 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.827165 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.827373 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.827456 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.827678 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.827767 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.827980 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.828064 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.828315 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.828408 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.828631 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.828715 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.828934 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.829023 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.829240 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.829332 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.829548 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.829627 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.829848 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.829928 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.830154 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.830240 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.830462 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.830547 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.830766 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.830850 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.831092 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.831192 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.831412 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.831669 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.831761 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.831984 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.832068 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.832301 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.832392 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.832607 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.832731 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.832904 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.832988 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.833205 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.833288 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.833505 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.833600 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.833810 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.833895 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.834112 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.834202 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.834412 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.834504 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.834715 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.834800 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.835029 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.835172 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.835346 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.835484 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.835665 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.835791 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.835974 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.836095 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.836279 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.836413 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.836581 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.836735 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.836899 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.837049 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.837292 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.837390 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.837564 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.837649 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.837904 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.837997 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 15:53:29.838216 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.838303 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.838545 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.838630 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.838872 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.839017 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.839213 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.839295 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.839522 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.839605 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.839832 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.839930 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.840155 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.840294 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.840462 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.840552 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.840769 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.840879 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.841076 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.841161 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.841389 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.841472 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.841701 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.841787 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.842010 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.842092 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.842324 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.842405 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.842642 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.842768 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.842956 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.843084 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.843282 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.843366 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.843596 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.843681 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.844442 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.844534 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.844758 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.844841 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.845065 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.845152 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.845397 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.845529 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.845717 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.845801 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.846030 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.846134 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.846348 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.846433 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.846658 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.846749 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.847016 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.847145 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.847311 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.847399 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.847656 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.847759 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.847967 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.848052 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.848294 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.848421 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.848605 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.848744 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.848915 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.849062 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.849249 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.849400 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.849565 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.849701 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.849880 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.850018 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.850186 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.850358 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.850491 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.850681 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.850794 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.851022 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.851123 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.851336 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.851430 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.851646 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.851730 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.851954 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.852037 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.852268 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.852364 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.852578 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.852668 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.852904 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.853003 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.853230 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.853322 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.853538 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.853620 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.853839 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.853923 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.854148 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.854242 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.854462 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.854547 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.854766 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.854858 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.855096 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.855182 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.855408 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.855491 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.855713 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.855798 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.856020 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.856103 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.856321 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.856410 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.856626 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.856710 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.856937 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.857021 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.857243 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.857332 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.857599 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.857690 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.857859 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.857944 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.858177 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.858262 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.858487 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.858583 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.859048 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.859144 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.859144 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.859264 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.859510 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.860094 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.860329 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.860415 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.860647 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.860743 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.860970 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.861065 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.861286 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.861370 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.861590 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.861674 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.861898 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.861990 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.862203 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.862288 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.862507 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.862591 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.862810 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.862910 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.863144 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.863257 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.863446 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.863569 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.863752 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.863872 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.864054 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.864146 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.864364 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.864454 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.864664 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.864807 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.864970 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.865059 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.865276 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.865363 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.865577 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.865663 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.865880 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.865965 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.866182 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.866275 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.866497 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.866587 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.866803 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.866888 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.867147 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.867247 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.867456 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.867541 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.867799 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.867884 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.868110 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.868202 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.868452 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.868540 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.868762 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.868852 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.869071 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.869165 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.869383 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.869468 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.869692 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.869775 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.870003 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.870096 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.870316 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.870399 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.870630 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.870714 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.870941 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.871071 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.871279 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.871366 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.871602 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.871686 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.871914 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.872000 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.872233 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.872318 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.872547 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.872631 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.872861 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.872945 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.873201 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.873312 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.873501 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.873608 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.873806 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.873892 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.874123 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.874215 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.874434 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.874530 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.874746 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.874830 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.875098 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.875189 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.875412 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.875507 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.875722 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.875808 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.876031 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.876116 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.876349 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.876442 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.876659 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.876742 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.876973 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.877056 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.877277 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.877373 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.877596 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.877687 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.877900 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.877990 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.878216 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.878307 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.878520 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.878605 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.878831 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.878916 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.879172 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.879259 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.879494 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.879578 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.879800 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.879883 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.880111 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.880204 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.880427 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.880510 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.880735 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.880826 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.881043 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.881128 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.881351 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.881436 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.881656 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.881748 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.881961 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.882046 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.882267 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.882351 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.882575 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.882667 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.882881 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.882964 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.883210 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.883356 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.883513 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.883611 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.883824 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.883908 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.884128 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.884212 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.884434 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.884531 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.884735 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.884826 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.885044 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.885133 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.885353 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.885439 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.885660 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.885733 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.885963 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.886036 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.886274 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.886355 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.886573 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.886653 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.886876 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.886950 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.887227 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.887305 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.887533 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.887613 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.887835 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.887909 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.888139 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.888213 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.888437 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.888511 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.888757 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.888837 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.889066 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.889149 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.889365 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.889438 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.889669 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.889750 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.889988 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.890061 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.890295 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.890386 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.890608 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.890744 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.891022 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.891116 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.891337 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.891433 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.891660 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.891795 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.891975 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.892082 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.892284 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.892596 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.892689 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.892907 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.893175 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.893267 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.893583 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.893689 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.893907 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.893992 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.894218 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.894303 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.894536 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.894640 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.894849 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.894952 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.895175 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.895294 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.895487 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.895571 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.895805 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.895894 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.896138 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.896386 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.896498 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.896718 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.896813 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.897033 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.897121 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.897350 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.897445 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.897670 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.897756 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.897987 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.898357 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.898506 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.898705 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.898862 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.899042 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.899214 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.899352 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.900655 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.900771 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.900771 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.900942 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.900942 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.901140 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.901218 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.901294 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.901380 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.901465 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.901465 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.901605 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.901688 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.901773 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.901848 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.901911 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.902091 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.902184 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.902396 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.902488 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.902708 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.902799 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.903039 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.903127 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.903354 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.903452 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.903659 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.903753 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.903970 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.904055 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.904276 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.904403 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.904586 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.904672 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.904891 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.904975 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.905193 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.905277 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.905498 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.905596 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.905801 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.905886 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.906123 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.906206 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.906957 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.907140 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.907308 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.907393 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.907622 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.907707 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.907932 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.908026 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.908243 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.908334 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.908551 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.908634 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.908874 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.908961 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.909177 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.909260 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.909483 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.909566 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.909837 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.910012 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.910182 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.910467 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.910558 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.910783 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.910876 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.911118 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.911207 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.911428 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.911512 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.911736 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.911832 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.912043 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.912129 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.912350 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.912434 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.912656 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.912742 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.912960 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.913051 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.913263 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.913425 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.913576 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.913803 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.913895 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.913973 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.914176 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.914261 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.914479 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.914657 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.914789 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.914875 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.915118 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.915208 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.915421 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.915507 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.915730 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.915823 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.916033 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.916125 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.916340 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.916425 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.916640 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.916724 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.916944 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.917041 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.917247 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.917336 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.917599 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.917704 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.917856 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.917950 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.918334 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.918427 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.918508 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.918584 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.918754 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.918850 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.919099 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.919196 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.919390 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.919478 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.919697 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.919782 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.919996 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.920080 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.920299 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.920383 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.920606 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.920692 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.920909 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.921000 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.921289 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.921389 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.921518 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.921612 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.921820 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.921932 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.922688 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.922782 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.923020 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.923109 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.923583 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.923672 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.923895 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.923992 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.924199 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.924284 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.924502 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.924587 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.924805 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.924903 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.925107 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.925197 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.925409 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.925494 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.925717 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.925810 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.926024 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.926108 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.926324 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.926416 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.926627 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.926718 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.926925 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.927022 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.927257 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.927340 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.927580 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.927674 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.927890 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.927974 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.928198 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.928283 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.928506 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.928582 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.928811 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.928897 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.929125 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.929197 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.929437 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.929533 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.929748 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.929834 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.930049 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.930123 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.930357 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.930450 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.930656 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.930732 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.931014 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.931195 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.931310 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.931421 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.931611 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.931736 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.931922 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.932042 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.932232 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.932351 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.932543 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.932653 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.932861 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.932983 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.933169 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.933284 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.933477 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.933605 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.933789 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.933901 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.934103 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.934205 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.934411 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.934519 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.934715 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.934825 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.935069 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.935158 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.935401 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.935516 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.935708 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.935807 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.936023 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.936124 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.936331 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.936431 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.936641 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.936740 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.936947 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.937055 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.937253 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.937355 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.937586 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.937683 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.937903 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.938006 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.938206 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.938307 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.938519 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.938609 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.938830 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.938930 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.939159 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.939263 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.939470 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.939568 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.939770 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.939859 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.940075 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.940180 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.940379 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.940469 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.940700 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.940812 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.941006 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.941111 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.941319 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.941410 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.941627 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.941718 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.941939 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.942030 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.942248 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.942339 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.942616 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.942716 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.942933 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.943060 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.943262 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.943352 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.943605 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.943754 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.943920 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.944020 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.944234 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.944336 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.944555 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.944654 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.944866 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.944955 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.945175 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.945273 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.945485 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.945587 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.945808 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.945896 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.946153 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.946294 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.946412 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.946515 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.946717 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.946814 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.947068 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.947172 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.947375 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.947517 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.947696 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.947829 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.948064 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.948203 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.948374 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.948526 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.948673 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.948825 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.948995 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.949133 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.949315 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.949512 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.949632 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.949775 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.950019 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.950183 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.950339 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.950475 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.950660 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.950808 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.951085 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.951223 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.951360 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.951482 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.951599 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.951714 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.951916 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.952062 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.952237 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.952423 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.952548 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.952673 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.952851 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.953011 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.953151 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.953295 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.953510 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.953672 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.953830 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.953951 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.954143 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.954276 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.954466 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.954597 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.954843 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.955037 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.955177 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.955286 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.955513 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.955621 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.955836 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.955954 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.956153 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.956276 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.956452 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.956568 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.956756 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.956893 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.957064 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.957222 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.957366 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.957540 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.957675 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.957869 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.958001 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.958198 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.958291 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.958508 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.958594 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.958823 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.958998 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.959171 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.959286 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.959477 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.959589 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.959791 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.959934 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.960106 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.960190 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.960408 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.960494 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.960723 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.960815 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.961034 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.961120 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.961348 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.961439 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.961658 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.961755 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.961959 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.962043 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.962281 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.962409 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.962587 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.962681 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.962891 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.962997 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.963218 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.963303 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.963521 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.963608 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.963860 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.963944 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.964165 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.964250 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.964484 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.964615 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.964794 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.964935 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.965104 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.965198 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.965415 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.965501 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.965726 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.965818 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.966049 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.966142 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.966363 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.966447 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.966678 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.966771 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.967044 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.967147 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.967326 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.967412 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.967629 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.967731 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.967936 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.968028 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.968237 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.968321 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.968541 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.968626 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.969383 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.969486 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.969693 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.969784 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.969995 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.970080 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.970298 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.970411 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.970598 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.970694 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.970918 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.971016 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.971246 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.971340 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.971551 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.971634 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.971860 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.971945 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.972165 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.972257 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.972466 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.972603 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.972766 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.972861 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.973088 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.973172 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.973395 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.973481 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.973719 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.973816 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.974030 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.974161 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.974343 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.974430 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.974652 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.974748 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.974959 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.975083 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.975319 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.975404 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.975626 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.975718 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.975936 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.976021 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.976251 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.976334 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.976565 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.976650 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.976877 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.976963 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.977190 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.977274 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.977503 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.977589 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.977813 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.977906 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.978128 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.978250 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.978442 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.978533 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.978756 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.978841 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.979098 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.979352 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.979450 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.979682 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.979767 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.979996 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.980093 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.980309 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.980395 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.980620 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.980705 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.980931 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.981015 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.981244 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.981500 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.981594 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.981833 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.981918 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.982147 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.982240 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.982455 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.982586 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.982772 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.982866 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.983116 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.983216 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.983438 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.983524 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.983755 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.983841 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.984072 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.984159 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.984385 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.984527 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.985247 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.985335 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.985580 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.985667 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.985904 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.985990 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.986234 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.986335 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.986538 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.986623 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.986852 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.986944 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.987197 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.987358 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.987512 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.987652 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.987828 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.987971 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.988136 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.988304 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.988447 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.988582 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.988732 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.988869 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.989041 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.989129 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.989348 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.989433 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.989661 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.989753 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.989971 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.990065 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.990295 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.990388 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.990609 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.990702 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.990926 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.991047 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.991264 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.991348 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.991577 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.991671 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.991893 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.991976 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.992212 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.992423 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.992543 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.992835 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.992913 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.993061 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.993190 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.993384 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.993508 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.993709 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.993824 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.994026 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.994142 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.994342 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.994665 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.994751 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.995032 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.995123 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.995302 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.995390 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.995612 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.995700 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.995923 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.996014 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.996226 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.996312 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.996546 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.996638 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.996853 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.996938 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.997156 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.997249 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.997475 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.997560 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.997783 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.997869 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.998096 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.998311 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.998397 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.998659 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.998745 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.998990 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.999079 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.999325 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.999413 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.999647 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.999732 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:29.999960 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.000223 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.000390 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.000519 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.000686 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.000873 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.000993 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.001196 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.001307 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.001527 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.001614 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.001862 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.001982 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.002178 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.002271 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.002478 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.002570 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.002787 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.002935 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.003107 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.003194 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.003442 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.003538 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.003719 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.003806 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.004021 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.004107 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.004344 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.004470 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.004649 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.004747 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.004954 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.005040 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.005264 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.005407 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.005566 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.005673 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.005866 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.005957 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.006169 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.006254 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.006470 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.006565 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.006779 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.006940 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.007123 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.007259 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.007390 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.007487 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.007685 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.007771 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.007986 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.008078 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.008293 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.008390 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.008590 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.008702 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.008894 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.008983 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.009196 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.009291 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.009508 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.009601 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.009809 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.009897 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.010109 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.010209 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.010419 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.010504 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.010725 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.010821 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.011055 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.011144 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.011365 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.011463 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.011671 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.011768 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.011991 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.012075 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.012297 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.012390 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.012652 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.012852 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.012981 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.013242 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.013330 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.013553 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.013637 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.013868 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.013956 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.014196 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.014282 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.014501 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.014636 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.014807 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.015083 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.015172 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.015458 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.015554 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.015813 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.015904 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.016124 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.016208 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.016433 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.016530 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.016743 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.016836 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.017052 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.017138 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.017361 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.017447 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.017669 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.017756 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.017977 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.018063 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.018286 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.018405 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.018592 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.018680 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.018901 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.019033 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.019249 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.019344 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.019564 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.019658 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.019876 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.019962 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.020188 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.020286 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.020502 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.020588 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.020810 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.020901 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.021158 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.021306 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.021436 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.021522 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.021744 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.021830 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.022058 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.022146 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.022386 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.022472 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.022698 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.022783 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.023021 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.023162 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.023349 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.023452 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.023666 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.023750 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.023979 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.024066 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.024300 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.024385 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.024633 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.024765 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.024951 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.025038 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.025262 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.025353 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.025588 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.025729 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.025907 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.025993 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.026215 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.026299 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.026541 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.026635 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.026885 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.027011 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.027225 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.027312 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.027554 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.027653 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.027852 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.027937 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.028155 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.028240 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.028458 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.028546 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.028765 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.028858 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.029093 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.029185 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.029423 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.029527 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.029739 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.029893 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.030040 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.030191 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.030338 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.030500 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.030701 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.030854 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.031127 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.031230 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.031828 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.031971 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.032137 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.032226 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.032460 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.032553 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.032770 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.032897 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.033083 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.033174 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.033394 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.033487 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.033708 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.033833 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.034015 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.034111 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.034326 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.034423 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.034637 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.034734 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.034946 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.035098 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.035295 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.035383 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.035607 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.035691 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.035920 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.036006 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.036237 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.036322 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.036552 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.036636 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.036867 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.036983 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.037180 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.037268 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.037487 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.037573 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.037815 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.037914 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.038124 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.038208 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.038434 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.038518 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.038745 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.038839 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.039083 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.039173 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.039400 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.039494 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.039713 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.039799 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.040037 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.040123 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.040352 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.040443 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.040673 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.040761 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.040992 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.041077 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.041309 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.041396 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.041632 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.041719 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.041958 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.042081 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.042287 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.042383 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.042602 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.042696 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.042913 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.043036 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.043241 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.043366 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.043485 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 19 15:53:30.043610 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.043930 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.044279 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.044611 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.044931 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.045249 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.045559 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 15:53:30.045806 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 19 15:53:30.068050 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG oslo_db.sqlalchemy.engines [None req-2d405c35-e7de-47f1-9261-cb0806d3c05a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114012) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 15:53:30.069033 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG oslo_db.sqlalchemy.engines [None req-721095e6-392b-4f9e-9732-527fc2de431f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 15:53:30.136530 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.context [None req-721095e6-392b-4f9e-9732-527fc2de431f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),753ba822-f6b2-435f-a99e-73d7149d7f8d(cell1) {{(pid=114011) load_cells /opt/stack/nova/nova/context.py:464}} Jan 19 15:53:30.136741 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.context [None req-2d405c35-e7de-47f1-9261-cb0806d3c05a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),753ba822-f6b2-435f-a99e-73d7149d7f8d(cell1) {{(pid=114012) load_cells /opt/stack/nova/nova/context.py:464}} Jan 19 15:53:30.141323 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG oslo_concurrency.lockutils [None req-721095e6-392b-4f9e-9732-527fc2de431f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 15:53:30.141465 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG oslo_concurrency.lockutils [None req-2d405c35-e7de-47f1-9261-cb0806d3c05a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 15:53:30.143010 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG oslo_concurrency.lockutils [None req-721095e6-392b-4f9e-9732-527fc2de431f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 15:53:30.143276 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG oslo_concurrency.lockutils [None req-2d405c35-e7de-47f1-9261-cb0806d3c05a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 15:53:30.143831 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG oslo_concurrency.lockutils [None req-721095e6-392b-4f9e-9732-527fc2de431f None None] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 15:53:30.143929 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG oslo_concurrency.lockutils [None req-2d405c35-e7de-47f1-9261-cb0806d3c05a None None] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 15:53:30.146613 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG oslo_concurrency.lockutils [None req-2d405c35-e7de-47f1-9261-cb0806d3c05a None None] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 15:53:30.146772 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG oslo_concurrency.lockutils [None req-721095e6-392b-4f9e-9732-527fc2de431f None None] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 15:53:30.157513 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG oslo_db.sqlalchemy.engines [None req-721095e6-392b-4f9e-9732-527fc2de431f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 15:53:30.159961 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG oslo_db.sqlalchemy.engines [None req-2d405c35-e7de-47f1-9261-cb0806d3c05a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114012) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 15:53:30.162664 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG oslo_db.sqlalchemy.engines [None req-721095e6-392b-4f9e-9732-527fc2de431f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 15:53:30.166103 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG oslo_db.sqlalchemy.engines [None req-2d405c35-e7de-47f1-9261-cb0806d3c05a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114012) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 15:53:30.336388 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG oslo_db.sqlalchemy.engines [None req-721095e6-392b-4f9e-9732-527fc2de431f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 15:53:30.356386 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG oslo_db.sqlalchemy.engines [None req-2d405c35-e7de-47f1-9261-cb0806d3c05a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114012) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 15:53:30.782984 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: WARNING keystonemiddleware.auth_token [None req-721095e6-392b-4f9e-9732-527fc2de431f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 15:53:30.789761 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: WARNING keystonemiddleware.auth_token [None req-721095e6-392b-4f9e-9732-527fc2de431f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 15:53:30.872406 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: WARNING keystonemiddleware.auth_token [None req-2d405c35-e7de-47f1-9261-cb0806d3c05a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 15:53:30.880006 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: WARNING keystonemiddleware.auth_token [None req-2d405c35-e7de-47f1-9261-cb0806d3c05a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 15:53:31.136358 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: WARNING keystonemiddleware.auth_token [None req-721095e6-392b-4f9e-9732-527fc2de431f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 15:53:31.142023 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: WARNING keystonemiddleware.auth_token [None req-721095e6-392b-4f9e-9732-527fc2de431f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 15:53:31.147383 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cb261889c0 pid: 114011 (default app) Jan 19 15:53:31.149479 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-721095e6-392b-4f9e-9732-527fc2de431f None None] Calling method '>' {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:53:31.150654 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-721095e6-392b-4f9e-9732-527fc2de431f None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001763 Jan 19 15:53:31.151099 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Wed Jan 19 15:53:31 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 15:53:31.223155 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: WARNING keystonemiddleware.auth_token [None req-2d405c35-e7de-47f1-9261-cb0806d3c05a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 15:53:31.228649 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: WARNING keystonemiddleware.auth_token [None req-2d405c35-e7de-47f1-9261-cb0806d3c05a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 15:53:31.233820 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cb261889c0 pid: 114012 (default app) Jan 19 15:55:06.446511 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-721095e6-392b-4f9e-9732-527fc2de431f None None] Calling method '>' {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:55:06.448919 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-721095e6-392b-4f9e-9732-527fc2de431f None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002057 Jan 19 15:55:06.449775 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 2/2] 10.222.0.58 () {54 vars in 930 bytes} [Wed Jan 19 15:55:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 15:55:06.955917 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-29ac06a4-77ed-4936-af13-b071b6e70f81 admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:55:06.985526 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-29ac06a4-77ed-4936-af13-b071b6e70f81 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.528531 Jan 19 15:55:06.986380 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 1/3] 10.222.0.58 () {60 vars in 1291 bytes} [Wed Jan 19 15:55:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 15:55:09.521273 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-721095e6-392b-4f9e-9732-527fc2de431f None None] Calling method '>' {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:55:09.522240 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-721095e6-392b-4f9e-9732-527fc2de431f None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jan 19 15:55:09.522890 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 3/4] 10.222.0.58 () {54 vars in 930 bytes} [Wed Jan 19 15:55:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 15:55:09.589749 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-c72faad2-a36e-4f7a-9299-02d70280f2e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256", "os-flavor-access:is_public": true, "disk": 1, "id": "c1", "swap": 0}} {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 15:55:09.608363 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 15:55:09.608363 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: warnings.warn(msg) Jan 19 15:55:09.705758 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-c72faad2-a36e-4f7a-9299-02d70280f2e5 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.175769 Jan 19 15:55:09.706504 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 2/5] 10.222.0.58 () {64 vars in 1282 bytes} [Wed Jan 19 15:55:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 15:55:09.931346 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-3a41ce93-9e46-493b-8fe0-cedcfb237528 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 15:55:09.933993 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 15:55:09.933993 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: warnings.warn(msg) Jan 19 15:55:10.035742 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-3a41ce93-9e46-493b-8fe0-cedcfb237528 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.320164 Jan 19 15:55:10.036610 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 4/6] 10.222.0.58 () {64 vars in 1335 bytes} [Wed Jan 19 15:55:09 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 15:55:12.424873 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-c72faad2-a36e-4f7a-9299-02d70280f2e5 admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:55:12.427823 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-c72faad2-a36e-4f7a-9299-02d70280f2e5 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003262 Jan 19 15:55:12.429068 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 3/7] 10.222.0.58 () {54 vars in 930 bytes} [Wed Jan 19 15:55:12 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 15:55:12.557716 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-c7adcaf7-940b-4432-be75-71ddf8dc49d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "disk": 5, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1"}} {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 15:55:12.575724 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 15:55:12.575724 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: warnings.warn(msg) Jan 19 15:55:12.684940 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-c7adcaf7-940b-4432-be75-71ddf8dc49d7 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.246000 Jan 19 15:55:12.685621 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 5/8] 10.222.0.58 () {64 vars in 1282 bytes} [Wed Jan 19 15:55:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 15:55:12.697516 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-e248e8e0-394f-4795-b3f0-0b628a6bf2fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 15:55:12.699114 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 15:55:12.699114 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: warnings.warn(msg) Jan 19 15:55:12.813113 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-e248e8e0-394f-4795-b3f0-0b628a6bf2fb admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119019 Jan 19 15:55:12.814126 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 4/9] 10.222.0.58 () {64 vars in 1335 bytes} [Wed Jan 19 15:55:12 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 15:55:15.167693 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-c7adcaf7-940b-4432-be75-71ddf8dc49d7 admin admin] Calling method '>' {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:55:15.169286 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-c7adcaf7-940b-4432-be75-71ddf8dc49d7 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jan 19 15:55:15.169663 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 6/10] 10.222.0.58 () {54 vars in 930 bytes} [Wed Jan 19 15:55:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 15:55:15.234053 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-70cb2a1f-ae01-4b80-b127-8e73ac221aaf admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "id": "d2", "ram": 1024, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 15:55:15.335806 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-70cb2a1f-ae01-4b80-b127-8e73ac221aaf admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.158777 Jan 19 15:55:15.343403 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 5/11] 10.222.0.58 () {64 vars in 1282 bytes} [Wed Jan 19 15:55:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 15:55:15.356979 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-edbac544-d359-4514-a106-9786f454cbbe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 15:55:15.455281 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-edbac544-d359-4514-a106-9786f454cbbe admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105354 Jan 19 15:55:15.456065 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 7/12] 10.222.0.58 () {64 vars in 1335 bytes} [Wed Jan 19 15:55:15 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 15:55:18.046086 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-70cb2a1f-ae01-4b80-b127-8e73ac221aaf admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:55:18.047735 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-70cb2a1f-ae01-4b80-b127-8e73ac221aaf admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002475 Jan 19 15:55:18.049086 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 6/13] 10.222.0.58 () {54 vars in 930 bytes} [Wed Jan 19 15:55:18 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 15:55:18.137068 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-90a2da0f-e872-4538-8191-d322aaf1d87e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "vcpus": 2, "name": "ds2G"}} {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 15:55:18.219718 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-90a2da0f-e872-4538-8191-d322aaf1d87e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.159703 Jan 19 15:55:18.220936 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 8/14] 10.222.0.58 () {64 vars in 1282 bytes} [Wed Jan 19 15:55:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 15:55:18.242527 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-831cc4ea-8c8e-4323-8c71-0d3196bde245 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 15:55:18.333345 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-831cc4ea-8c8e-4323-8c71-0d3196bde245 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104476 Jan 19 15:55:18.335235 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 7/15] 10.222.0.58 () {64 vars in 1335 bytes} [Wed Jan 19 15:55:18 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 15:55:20.693673 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-90a2da0f-e872-4538-8191-d322aaf1d87e admin admin] Calling method '>' {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:55:20.694684 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-90a2da0f-e872-4538-8191-d322aaf1d87e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jan 19 15:55:20.695391 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 9/16] 10.222.0.58 () {54 vars in 930 bytes} [Wed Jan 19 15:55:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 15:55:20.795449 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-d730bcdc-d56f-4512-9b36-2ade5fd6bbfc admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "id": "d4"}} {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 15:55:20.901177 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-d730bcdc-d56f-4512-9b36-2ade5fd6bbfc admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.198473 Jan 19 15:55:20.902134 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 8/17] 10.222.0.58 () {64 vars in 1282 bytes} [Wed Jan 19 15:55:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 15:55:20.928948 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-d57ff169-5eb8-4cb0-a6a0-d5789d6d1c07 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 15:55:21.051096 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-d57ff169-5eb8-4cb0-a6a0-d5789d6d1c07 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.138088 Jan 19 15:55:21.052874 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 10/18] 10.222.0.58 () {64 vars in 1335 bytes} [Wed Jan 19 15:55:20 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 15:55:23.511325 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-d730bcdc-d56f-4512-9b36-2ade5fd6bbfc admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:55:23.514272 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-d730bcdc-d56f-4512-9b36-2ade5fd6bbfc admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003378 Jan 19 15:55:23.527097 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 9/19] 10.222.0.58 () {54 vars in 930 bytes} [Wed Jan 19 15:55:23 2022] GET /compute/v2.1 => generated 388 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 15:55:23.591165 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-f5f0aa0d-e0d2-4d17-8818-05f54c88260d admin admin] Calling method '>' {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:55:23.632191 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-f5f0aa0d-e0d2-4d17-8818-05f54c88260d admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.108741 Jan 19 15:55:23.632800 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 11/20] 10.222.0.58 () {60 vars in 1291 bytes} [Wed Jan 19 15:55:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 15:55:26.431473 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-d730bcdc-d56f-4512-9b36-2ade5fd6bbfc admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:55:26.432532 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-d730bcdc-d56f-4512-9b36-2ade5fd6bbfc admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001686 Jan 19 15:55:26.433302 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 10/21] 10.222.0.58 () {54 vars in 930 bytes} [Wed Jan 19 15:55:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 15:55:26.499722 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-88c66a3b-11ed-4ffc-adc1-8bdaf6972aca admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "id": "1", "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny"}} {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 15:55:26.582517 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-88c66a3b-11ed-4ffc-adc1-8bdaf6972aca admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.142289 Jan 19 15:55:26.583104 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 12/22] 10.222.0.58 () {64 vars in 1282 bytes} [Wed Jan 19 15:55:26 2022] POST /compute/v2.1/flavors => generated 402 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 15:55:26.596463 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-4245e3ea-eac6-4131-9cf9-0af06ff1732b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 15:55:26.682931 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-4245e3ea-eac6-4131-9cf9-0af06ff1732b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091337 Jan 19 15:55:26.684150 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 11/23] 10.222.0.58 () {64 vars in 1332 bytes} [Wed Jan 19 15:55:26 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 15:55:29.008488 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-88c66a3b-11ed-4ffc-adc1-8bdaf6972aca admin admin] Calling method '>' {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:55:29.009506 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-88c66a3b-11ed-4ffc-adc1-8bdaf6972aca admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001740 Jan 19 15:55:29.009941 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 13/24] 10.222.0.58 () {54 vars in 930 bytes} [Wed Jan 19 15:55:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 15:55:29.086955 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-9f1cb193-cee4-4c4d-bcb7-19dceb847896 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 1, "rxtx_factor": 1.0, "disk": 20, "swap": 0}} {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 15:55:29.202515 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-9f1cb193-cee4-4c4d-bcb7-19dceb847896 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.185663 Jan 19 15:55:29.203113 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 12/25] 10.222.0.58 () {64 vars in 1282 bytes} [Wed Jan 19 15:55:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 15:55:29.217709 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-6871e7f2-d457-4ee5-a1f6-0fe29c4b5139 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 15:55:29.313408 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-6871e7f2-d457-4ee5-a1f6-0fe29c4b5139 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099847 Jan 19 15:55:29.314011 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 14/26] 10.222.0.58 () {64 vars in 1332 bytes} [Wed Jan 19 15:55:29 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 15:55:31.999372 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-9f1cb193-cee4-4c4d-bcb7-19dceb847896 admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:55:32.001420 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-9f1cb193-cee4-4c4d-bcb7-19dceb847896 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002431 Jan 19 15:55:32.001891 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 13/27] 10.222.0.58 () {54 vars in 930 bytes} [Wed Jan 19 15:55:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 15:55:32.074548 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-5e570c10-1f23-4d4d-bafa-bda55f8f493f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "3", "ram": 4096}} {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 15:55:32.167096 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-5e570c10-1f23-4d4d-bafa-bda55f8f493f admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.152594 Jan 19 15:55:32.168025 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 15/28] 10.222.0.58 () {64 vars in 1282 bytes} [Wed Jan 19 15:55:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 15:55:32.180545 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-4a58d05e-c690-40af-8ee1-ec5818e37880 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 15:55:32.255391 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-4a58d05e-c690-40af-8ee1-ec5818e37880 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078687 Jan 19 15:55:32.256118 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 14/29] 10.222.0.58 () {64 vars in 1332 bytes} [Wed Jan 19 15:55:32 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 15:55:34.563120 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-5e570c10-1f23-4d4d-bafa-bda55f8f493f admin admin] Calling method '>' {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:55:34.564149 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-5e570c10-1f23-4d4d-bafa-bda55f8f493f admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001617 Jan 19 15:55:34.564683 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 16/30] 10.222.0.58 () {54 vars in 930 bytes} [Wed Jan 19 15:55:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 15:55:34.638885 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-6daf38d8-c686-4e0a-a4df-bf5346df1ee6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "swap": 0, "name": "m1.large", "rxtx_factor": 1.0, "id": "4", "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 15:55:34.723771 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-6daf38d8-c686-4e0a-a4df-bf5346df1ee6 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.151103 Jan 19 15:55:34.724167 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 15/31] 10.222.0.58 () {64 vars in 1282 bytes} [Wed Jan 19 15:55:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 15:55:34.736242 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-73c77819-795a-4a56-8d07-a0f2e622f22a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 15:55:34.832407 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-73c77819-795a-4a56-8d07-a0f2e622f22a admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099511 Jan 19 15:55:34.833625 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 17/32] 10.222.0.58 () {64 vars in 1332 bytes} [Wed Jan 19 15:55:34 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 15:55:37.848719 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-6daf38d8-c686-4e0a-a4df-bf5346df1ee6 admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:55:37.849801 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-6daf38d8-c686-4e0a-a4df-bf5346df1ee6 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Jan 19 15:55:37.850219 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 16/33] 10.222.0.58 () {54 vars in 930 bytes} [Wed Jan 19 15:55:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 15:55:37.915129 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-0e619b2f-14f6-460a-8714-e6dc818e2620 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 16384, "disk": 160, "id": "5", "rxtx_factor": 1.0, "swap": 0, "vcpus": 8, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 15:55:38.007567 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-0e619b2f-14f6-460a-8714-e6dc818e2620 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.150269 Jan 19 15:55:38.008130 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 18/34] 10.222.0.58 () {64 vars in 1282 bytes} [Wed Jan 19 15:55:37 2022] POST /compute/v2.1/flavors => generated 408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 15:55:38.019733 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-c24e0d87-adf2-4ea3-b0af-abcdde6e56ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 15:55:38.117326 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-c24e0d87-adf2-4ea3-b0af-abcdde6e56ab admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101087 Jan 19 15:55:38.117849 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 17/35] 10.222.0.58 () {64 vars in 1332 bytes} [Wed Jan 19 15:55:38 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 15:56:06.656716 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-0e619b2f-14f6-460a-8714-e6dc818e2620 admin admin] Calling method '>' {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:56:06.657724 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-0e619b2f-14f6-460a-8714-e6dc818e2620 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jan 19 15:56:06.658119 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 19/36] 10.222.0.58 () {54 vars in 930 bytes} [Wed Jan 19 15:56:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 15:56:06.716574 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-d5d3e318-963e-4c3c-ab62-7572c8bb084e admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:56:06.733716 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-d5d3e318-963e-4c3c-ab62-7572c8bb084e admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069514 Jan 19 15:56:06.734283 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 18/37] 10.222.0.58 () {60 vars in 1291 bytes} [Wed Jan 19 15:56:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 15:56:08.153001 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-0e619b2f-14f6-460a-8714-e6dc818e2620 admin admin] Calling method '>' {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:56:08.154014 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-0e619b2f-14f6-460a-8714-e6dc818e2620 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jan 19 15:56:08.154420 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 20/38] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Jan 19 15:56:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 15:56:08.366897 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-1a8a004f-339a-4470-a0cb-2542d7cfddfc admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:56:08.373179 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.wsgi [None req-1a8a004f-339a-4470-a0cb-2542d7cfddfc admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 19 15:56:08.373750 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-1a8a004f-339a-4470-a0cb-2542d7cfddfc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 15:56:08.374593 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-1a8a004f-339a-4470-a0cb-2542d7cfddfc admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059720 Jan 19 15:56:08.375157 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 19/39] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Jan 19 15:56:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 19 15:56:08.390103 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-c3d8dce2-604d-4514-81d9-6a2744e237a3 admin admin] Calling method '>' {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:56:08.407387 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-c3d8dce2-604d-4514-81d9-6a2744e237a3 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026359 Jan 19 15:56:08.407980 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 21/40] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Jan 19 15:56:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 15:56:08.418347 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-bb93f13e-b98c-47cd-a918-6a46d960f0e0 admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:56:08.440107 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-bb93f13e-b98c-47cd-a918-6a46d960f0e0 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025838 Jan 19 15:56:08.440679 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 20/41] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Jan 19 15:56:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 15:56:08.450578 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-0f0d7389-dc96-4a87-be27-a1fba3816ab8 admin admin] Calling method '>' {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:56:08.456286 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.wsgi [None req-0f0d7389-dc96-4a87-be27-a1fba3816ab8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 19 15:56:08.456851 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-0f0d7389-dc96-4a87-be27-a1fba3816ab8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 15:56:08.457636 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-0f0d7389-dc96-4a87-be27-a1fba3816ab8 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011055 Jan 19 15:56:08.458149 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 22/42] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Jan 19 15:56:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 19 15:56:09.790342 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-bb93f13e-b98c-47cd-a918-6a46d960f0e0 admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:56:09.790342 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-bb93f13e-b98c-47cd-a918-6a46d960f0e0 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jan 19 15:56:09.790895 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 21/43] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Jan 19 15:56:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 15:56:09.992400 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-4f0e28a7-2962-44cf-9370-56d340ceac21 admin admin] Calling method '>' {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:56:10.001732 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.wsgi [None req-4f0e28a7-2962-44cf-9370-56d340ceac21 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 19 15:56:10.002689 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-4f0e28a7-2962-44cf-9370-56d340ceac21 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 15:56:10.003536 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-4f0e28a7-2962-44cf-9370-56d340ceac21 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.065543 Jan 19 15:56:10.004298 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 23/44] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Jan 19 15:56:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 19 15:56:10.013996 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-9e81e295-01c4-4874-b75b-1e9ef57190c6 admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:56:10.030272 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-9e81e295-01c4-4874-b75b-1e9ef57190c6 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019577 Jan 19 15:56:10.030586 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 22/45] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Jan 19 15:56:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 15:56:10.040242 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-4b3a3358-b7c5-4035-a538-0399dfca186b admin admin] Calling method '>' {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:56:10.054534 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-4b3a3358-b7c5-4035-a538-0399dfca186b admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017762 Jan 19 15:56:10.055101 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 24/46] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Jan 19 15:56:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 15:56:10.065290 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-3b435634-0eb5-44d7-91a6-ccc34f0f09e0 admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:56:10.070647 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.wsgi [None req-3b435634-0eb5-44d7-91a6-ccc34f0f09e0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 19 15:56:10.071255 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-3b435634-0eb5-44d7-91a6-ccc34f0f09e0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 15:56:10.072063 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-3b435634-0eb5-44d7-91a6-ccc34f0f09e0 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010485 Jan 19 15:56:10.072590 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 23/47] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Jan 19 15:56:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 19 15:56:11.324337 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-4b3a3358-b7c5-4035-a538-0399dfca186b admin admin] Calling method '>' {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:56:11.325381 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-4b3a3358-b7c5-4035-a538-0399dfca186b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002052 Jan 19 15:56:11.325782 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 25/48] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Jan 19 15:56:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 15:56:11.524751 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-cb2ea314-aef8-433a-8d00-c2bf30dfabc3 admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:56:11.530049 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.wsgi [None req-cb2ea314-aef8-433a-8d00-c2bf30dfabc3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 19 15:56:11.530652 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-cb2ea314-aef8-433a-8d00-c2bf30dfabc3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 15:56:11.531431 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-cb2ea314-aef8-433a-8d00-c2bf30dfabc3 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058961 Jan 19 15:56:11.531956 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 24/49] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Jan 19 15:56:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 19 15:56:11.541404 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-f4e490f6-cf75-4783-a999-611bcc02d536 admin admin] Calling method '>' {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:56:11.555554 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-f4e490f6-cf75-4783-a999-611bcc02d536 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017786 Jan 19 15:56:11.556100 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 26/50] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Jan 19 15:56:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 15:56:11.566762 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-718df7ee-ece4-4854-ae93-4961d91f723e admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:56:11.579669 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-718df7ee-ece4-4854-ae93-4961d91f723e admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016814 Jan 19 15:56:11.580193 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 25/51] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Jan 19 15:56:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 15:56:11.589219 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-123af9d6-4c80-4df1-ad04-3b53a4911c4d admin admin] Calling method '>' {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:56:11.594428 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.wsgi [None req-123af9d6-4c80-4df1-ad04-3b53a4911c4d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 19 15:56:11.594998 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-123af9d6-4c80-4df1-ad04-3b53a4911c4d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 15:56:11.595782 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-123af9d6-4c80-4df1-ad04-3b53a4911c4d admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010054 Jan 19 15:56:11.596286 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 27/52] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Jan 19 15:56:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 19 15:56:12.874748 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-718df7ee-ece4-4854-ae93-4961d91f723e admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:56:12.875952 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-718df7ee-ece4-4854-ae93-4961d91f723e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jan 19 15:56:12.876354 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 26/53] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Jan 19 15:56:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 15:56:13.070321 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-a3ed6e4c-f727-47d4-87d6-4fc7346f8cdd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 15:56:13.160323 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-a3ed6e4c-f727-47d4-87d6-4fc7346f8cdd admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.143472 Jan 19 15:56:13.160818 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 28/54] 10.222.0.58 () {64 vars in 1235 bytes} [Wed Jan 19 15:56:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 15:56:14.423273 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-718df7ee-ece4-4854-ae93-4961d91f723e admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:56:14.424287 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-718df7ee-ece4-4854-ae93-4961d91f723e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001751 Jan 19 15:56:14.424695 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 27/55] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Jan 19 15:56:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 15:56:14.617517 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-f432c7da-540e-42e6-8bb5-41ab8e89b9e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 15:56:14.694416 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-f432c7da-540e-42e6-8bb5-41ab8e89b9e4 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.128281 Jan 19 15:56:14.694888 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 29/56] 10.222.0.58 () {64 vars in 1235 bytes} [Wed Jan 19 15:56:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 15:56:15.961429 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-718df7ee-ece4-4854-ae93-4961d91f723e admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:56:15.962409 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-718df7ee-ece4-4854-ae93-4961d91f723e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jan 19 15:56:15.962808 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 28/57] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Jan 19 15:56:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 15:56:16.157846 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-ac99308b-3cf6-4fdc-9ab7-116171df1bef admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 15:56:16.220667 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-ac99308b-3cf6-4fdc-9ab7-116171df1bef admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.114670 Jan 19 15:56:16.221119 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 30/58] 10.222.0.58 () {64 vars in 1235 bytes} [Wed Jan 19 15:56:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 15:56:17.469709 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-718df7ee-ece4-4854-ae93-4961d91f723e admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:56:17.470701 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-718df7ee-ece4-4854-ae93-4961d91f723e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jan 19 15:56:17.471118 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 29/59] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Jan 19 15:56:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 15:56:17.665609 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-cb810c2e-ab18-4d7b-bf36-4c04cfc4032f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 15:56:17.737727 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-cb810c2e-ab18-4d7b-bf36-4c04cfc4032f admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.123749 Jan 19 15:56:17.738193 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 31/60] 10.222.0.58 () {64 vars in 1235 bytes} [Wed Jan 19 15:56:17 2022] POST /compute/v2.1/flavors => generated 409 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 15:56:19.011857 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-718df7ee-ece4-4854-ae93-4961d91f723e admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:56:19.012844 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-718df7ee-ece4-4854-ae93-4961d91f723e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001988 Jan 19 15:56:19.013236 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 30/61] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Jan 19 15:56:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 15:56:19.205520 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-45397114-89fd-4d11-9734-7d53438a6253 admin admin] Calling method '>' {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:56:19.224679 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-45397114-89fd-4d11-9734-7d53438a6253 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070276 Jan 19 15:56:19.225151 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 32/62] 10.222.0.58 () {60 vars in 1202 bytes} [Wed Jan 19 15:56:19 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 15:57:06.005619 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-718df7ee-ece4-4854-ae93-4961d91f723e admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:57:06.006626 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-718df7ee-ece4-4854-ae93-4961d91f723e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jan 19 15:57:06.007074 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 31/63] 10.222.0.58 () {54 vars in 930 bytes} [Wed Jan 19 15:57:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 15:57:06.065246 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-0149f9e8-2209-4965-bc35-bf4249dcc481 admin admin] Calling method '>' {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:57:06.083839 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-0149f9e8-2209-4965-bc35-bf4249dcc481 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070876 Jan 19 15:57:06.084371 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 33/64] 10.222.0.58 () {60 vars in 1291 bytes} [Wed Jan 19 15:57:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 15:57:06.106090 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-30ae2d0b-5800-48d0-b110-743d77015ee4 admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:57:06.113808 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-30ae2d0b-5800-48d0-b110-743d77015ee4 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011810 Jan 19 15:57:06.114333 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 32/65] 10.222.0.58 () {60 vars in 1282 bytes} [Wed Jan 19 15:57:06 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 15:57:06.126078 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-ee37a178-859c-4cf1-845e-a56720500b55 admin admin] Calling method '>' {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:57:06.133731 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-ee37a178-859c-4cf1-845e-a56720500b55 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011124 Jan 19 15:57:06.134249 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 34/66] 10.222.0.58 () {60 vars in 1285 bytes} [Wed Jan 19 15:57:06 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 15:57:06.145246 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-1dda7abf-7f53-4669-ac1e-8a794ceacf00 admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:57:06.152771 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-1dda7abf-7f53-4669-ac1e-8a794ceacf00 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011047 Jan 19 15:57:06.153298 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 33/67] 10.222.0.58 () {60 vars in 1285 bytes} [Wed Jan 19 15:57:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 15:57:06.164193 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-36c8400a-850c-4e19-8385-e913ba6470f9 admin admin] Calling method '>' {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:57:06.172226 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-36c8400a-850c-4e19-8385-e913ba6470f9 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011520 Jan 19 15:57:06.172998 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 35/68] 10.222.0.58 () {60 vars in 1282 bytes} [Wed Jan 19 15:57:06 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 15:58:51.580583 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-c6d94118-08ec-40ab-bac6-b1d97ad798e3 tempest-verify_tempest_config-1777257654 tempest-verify_tempest_config-1777257654-project] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 15:58:51.583153 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-c6d94118-08ec-40ab-bac6-b1d97ad798e3 tempest-verify_tempest_config-1777257654 tempest-verify_tempest_config-1777257654-project] 10.222.0.58 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.109432 Jan 19 15:58:51.583746 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 34/69] 10.222.0.58 () {58 vars in 1133 bytes} [Wed Jan 19 15:58:51 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:00:22.155919 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-36c8400a-850c-4e19-8385-e913ba6470f9 admin admin] Calling method '>' {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:00:22.156916 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-36c8400a-850c-4e19-8385-e913ba6470f9 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jan 19 16:00:22.157306 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 36/70] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Jan 19 16:00:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:00:22.412331 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-cf78fac0-d4aa-4c66-a81c-c54a39acfa86 admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:00:22.413505 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:00:22.413505 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: warnings.warn(msg) Jan 19 16:00:22.415147 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG oslo_concurrency.lockutils [None req-cf78fac0-d4aa-4c66-a81c-c54a39acfa86 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:00:22.415593 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG oslo_concurrency.lockutils [None req-cf78fac0-d4aa-4c66-a81c-c54a39acfa86 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:00:22.416390 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG oslo_concurrency.lockutils [None req-cf78fac0-d4aa-4c66-a81c-c54a39acfa86 admin admin] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:00:22.416814 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG oslo_concurrency.lockutils [None req-cf78fac0-d4aa-4c66-a81c-c54a39acfa86 admin admin] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:00:22.450002 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-cf78fac0-d4aa-4c66-a81c-c54a39acfa86 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152199 Jan 19 16:00:22.450572 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 35/71] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Jan 19 16:00:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:00:23.735324 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-36c8400a-850c-4e19-8385-e913ba6470f9 admin admin] Calling method '>' {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:00:23.736361 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-36c8400a-850c-4e19-8385-e913ba6470f9 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001622 Jan 19 16:00:23.736767 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 37/72] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Jan 19 16:00:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:00:23.935410 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-82222458-d633-49b7-8a68-b9ba074ca5e1 admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:00:23.936583 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:00:23.936583 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: warnings.warn(msg) Jan 19 16:00:23.938106 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG oslo_concurrency.lockutils [None req-82222458-d633-49b7-8a68-b9ba074ca5e1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:00:23.938538 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG oslo_concurrency.lockutils [None req-82222458-d633-49b7-8a68-b9ba074ca5e1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:00:23.939392 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG oslo_concurrency.lockutils [None req-82222458-d633-49b7-8a68-b9ba074ca5e1 admin admin] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:00:23.939813 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG oslo_concurrency.lockutils [None req-82222458-d633-49b7-8a68-b9ba074ca5e1 admin admin] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:00:23.959209 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-82222458-d633-49b7-8a68-b9ba074ca5e1 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077413 Jan 19 16:00:23.959779 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 36/73] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Jan 19 16:00:23 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:00:35.661535 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-36c8400a-850c-4e19-8385-e913ba6470f9 admin admin] Calling method '>' {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:00:35.662582 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-36c8400a-850c-4e19-8385-e913ba6470f9 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jan 19 16:00:35.663005 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 38/74] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Jan 19 16:00:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:00:35.866156 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-fb1000ec-011c-4163-a4bc-a0f729891288 admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:00:35.867674 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:00:35.867674 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: warnings.warn(msg) Jan 19 16:00:35.869214 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG oslo_concurrency.lockutils [None req-fb1000ec-011c-4163-a4bc-a0f729891288 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:00:35.869649 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG oslo_concurrency.lockutils [None req-fb1000ec-011c-4163-a4bc-a0f729891288 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:00:35.870468 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG oslo_concurrency.lockutils [None req-fb1000ec-011c-4163-a4bc-a0f729891288 admin admin] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:00:35.871305 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG oslo_concurrency.lockutils [None req-fb1000ec-011c-4163-a4bc-a0f729891288 admin admin] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:00:35.895636 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-fb1000ec-011c-4163-a4bc-a0f729891288 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088729 Jan 19 16:00:35.896180 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 37/75] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Jan 19 16:00:35 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:00:37.185476 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: DEBUG nova.api.openstack.wsgi [None req-36c8400a-850c-4e19-8385-e913ba6470f9 admin admin] Calling method '>' {{(pid=114011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:00:37.186558 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: INFO nova.api.openstack.requestlog [None req-36c8400a-850c-4e19-8385-e913ba6470f9 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jan 19 16:00:37.187212 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: [pid: 114011|app: 0|req: 39/76] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Jan 19 16:00:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:00:37.379677 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG nova.api.openstack.wsgi [None req-318c8af4-449b-4d6b-bf55-2e6b069c4f12 admin admin] Calling method '>' {{(pid=114012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:00:37.380850 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:00:37.380850 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: warnings.warn(msg) Jan 19 16:00:37.382420 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG oslo_concurrency.lockutils [None req-318c8af4-449b-4d6b-bf55-2e6b069c4f12 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:00:37.382860 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG oslo_concurrency.lockutils [None req-318c8af4-449b-4d6b-bf55-2e6b069c4f12 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:00:37.383685 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG oslo_concurrency.lockutils [None req-318c8af4-449b-4d6b-bf55-2e6b069c4f12 admin admin] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:00:37.384114 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: DEBUG oslo_concurrency.lockutils [None req-318c8af4-449b-4d6b-bf55-2e6b069c4f12 admin admin] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:00:37.405138 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: INFO nova.api.openstack.requestlog [None req-318c8af4-449b-4d6b-bf55-2e6b069c4f12 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076735 Jan 19 16:00:37.405619 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: [pid: 114012|app: 0|req: 38/77] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Jan 19 16:00:37 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:01:36.115698 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: Wed Jan 19 16:01:36 2022 - graceful shutdown triggered... Jan 19 16:01:36.116286 dv-cinder-820027-5-iscsi devstack@n-api.service[114011]: Gracefully killing worker 1 (pid: 114011)... Jan 19 16:01:36.116723 dv-cinder-820027-5-iscsi devstack@n-api.service[114012]: Gracefully killing worker 2 (pid: 114012)... Jan 19 16:01:36.116505 dv-cinder-820027-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 19 16:01:37.117402 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: worker 1 buried after 1 seconds Jan 19 16:01:37.117402 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: worker 2 buried after 1 seconds Jan 19 16:01:37.117402 dv-cinder-820027-5-iscsi devstack@n-api.service[114010]: goodbye to uWSGI. Jan 19 16:01:37.119035 dv-cinder-820027-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 19 16:01:37.119584 dv-cinder-820027-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 19 16:01:37.122457 dv-cinder-820027-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 19 16:01:37.136979 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 19 16:01:37.139855 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jan 19 16:01:37 2022] *** Jan 19 16:01:37.139855 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 19 16:01:37.139855 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 19 16:01:37.139855 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: nodename: dv-cinder-820027-5-iscsi Jan 19 16:01:37.139855 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: machine: x86_64 Jan 19 16:01:37.139855 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: clock source: unix Jan 19 16:01:37.139855 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: pcre jit disabled Jan 19 16:01:37.139855 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: detected number of CPU cores: 4 Jan 19 16:01:37.139855 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: current working directory: / Jan 19 16:01:37.139855 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: detected binary path: /usr/bin/uwsgi-core Jan 19 16:01:37.139855 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: your processes number limit is 47680 Jan 19 16:01:37.139855 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: your memory page size is 4096 bytes Jan 19 16:01:37.139855 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: detected max file descriptor number: 2048 Jan 19 16:01:37.139855 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: lock engine: pthread robust mutexes Jan 19 16:01:37.140882 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: thunder lock: enabled Jan 19 16:01:37.140882 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 19 16:01:37.140882 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 19 16:01:37.188391 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: Python main interpreter initialized at 0x55b20333a9c0 Jan 19 16:01:37.188391 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: python threads support enabled Jan 19 16:01:37.188391 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: your server socket listen backlog is limited to 100 connections Jan 19 16:01:37.188391 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: your mercy for graceful operations on workers is 90 seconds Jan 19 16:01:37.188822 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: mapped 403077 bytes (393 KB) for 2 cores Jan 19 16:01:37.188822 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: *** Operational MODE: preforking *** Jan 19 16:01:37.189098 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: *** uWSGI is running in multiple interpreter mode *** Jan 19 16:01:37.189098 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: spawned uWSGI master process (pid: 128854) Jan 19 16:01:37.189300 dv-cinder-820027-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 19 16:01:37.189877 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: spawned uWSGI worker 1 (pid: 128875, cores: 1) Jan 19 16:01:37.190421 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: spawned uWSGI worker 2 (pid: 128876, cores: 1) Jan 19 16:01:37.190739 dv-cinder-820027-5-iscsi devstack@n-api.service[128854]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 19 16:01:39.203543 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 16:01:39.203543 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: from cryptography.utils import int_from_bytes Jan 19 16:01:39.204317 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 16:01:39.204317 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: from cryptography.utils import int_from_bytes Jan 19 16:01:39.207172 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 16:01:39.207172 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: from cryptography.utils import int_from_bytes Jan 19 16:01:39.207666 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 16:01:39.207666 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: from cryptography.utils import int_from_bytes Jan 19 16:01:41.663868 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 19 16:01:41.664517 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 19 16:01:41.665458 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 19 16:01:41.665458 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 19 16:01:41.665458 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 19 16:01:41.665712 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.665912 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.666213 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 19 16:01:41.666606 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.666683 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 19 16:01:41.666765 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.666935 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.667056 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 19 16:01:41.667232 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.667335 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 19 16:01:41.667531 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.667640 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 19 16:01:41.667858 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.667975 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.668197 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.668305 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.668452 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.668546 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.668778 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.668893 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.669109 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-5-iscsi {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.669220 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.669438 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.669547 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.669756 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.669866 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.670074 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.670183 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.670385 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.670492 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.670661 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.670753 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.670949 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.671069 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.671347 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-5-iscsi {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.671450 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.671670 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.671866 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.672134 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.672457 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.673028 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.673350 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.673675 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.673983 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.674147 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.674497 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.674726 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.674833 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.675129 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.675302 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.675490 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.675787 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.675914 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.676652 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.676869 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.677094 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.677324 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.677546 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.677766 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.677983 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.678188 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.678401 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.678624 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.678836 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.679214 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.679405 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-5-iscsi {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.679607 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-5-iscsi {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.679769 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.679955 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.680129 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.680276 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.680496 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.680691 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.680852 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.680999 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.681151 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.681307 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.681463 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.681609 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.681769 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.681925 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.682125 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.682276 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.682440 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.682590 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.682749 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.682904 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.683090 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.683246 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.683392 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.683537 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.683696 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.683855 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.684001 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.684164 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.684318 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.684473 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.684627 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.684837 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.684994 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.684994 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.685278 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.685433 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.685930 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.686161 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.686319 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.686465 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.686629 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.686784 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.686939 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.687127 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.687274 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.687426 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.687578 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.687741 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.687899 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.688049 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.688203 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.688368 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.688524 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.688681 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.688833 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.688987 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.688987 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.689285 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.689438 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.689590 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.689741 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.689886 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.690052 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.690211 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.690364 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.690509 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.690659 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.690815 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.690985 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.691153 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.691381 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.691540 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.692268 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.692433 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.692588 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.692757 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.692910 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.693055 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.693199 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.693344 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.693502 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.693657 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.693809 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.693961 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.694106 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.694260 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.694417 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.694571 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.694734 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.694895 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.695074 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.695223 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.695380 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.695526 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.695688 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.696192 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.696349 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.696502 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.696658 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.696811 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.696964 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.697127 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.697282 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.697510 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.697658 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.697810 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.697955 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.697955 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.698237 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.698398 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.698554 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.698710 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.698861 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.698861 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.699242 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.699242 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.699242 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.699670 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.699815 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.699966 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.700118 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.700278 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.700424 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.700577 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.700731 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.700877 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.701050 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.701204 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.701356 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.701513 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.701660 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.701804 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.701972 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.702130 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.702276 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.702421 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.702642 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.702642 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.702945 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.703135 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.703289 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.703435 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.703587 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.703746 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.703893 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.704038 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.704190 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.704334 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.704480 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.704703 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.704860 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.705006 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.705174 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.705320 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.705472 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.705618 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.705764 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.705937 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.706441 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.706605 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.706753 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.706900 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.707081 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.707751 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.707925 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.708082 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.708228 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.708384 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.708537 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.708762 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.708911 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.709065 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.709221 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.709454 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.709609 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.709765 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.709910 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.710063 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.710230 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.710376 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.710528 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.710682 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.710682 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.711032 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.711186 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.711349 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.711509 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.711670 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.711816 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.711975 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.712131 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.712277 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.712421 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.712575 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.712728 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.712886 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.713032 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.713184 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.713336 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.713481 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.713631 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.713789 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.713941 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.714098 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.714244 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.714396 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.714554 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.714708 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.714855 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.715029 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.715190 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.715337 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.715491 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.715637 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.715782 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.715936 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.716098 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.716614 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:01:41.716784 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.716939 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.717085 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.717230 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.717383 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.717543 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.717698 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.717852 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.718007 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.718162 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.718329 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.718329 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.718626 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.718778 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.718934 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.719122 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.719271 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.719271 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.719564 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.719564 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.719855 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.720008 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.720164 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.720331 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.720478 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.720638 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.721396 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.721561 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.721561 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.721846 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.721999 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.722153 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.722314 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.722469 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.722627 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.722773 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.723554 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.723774 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.723933 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.724109 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.724256 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.724403 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.724548 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.724694 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.724853 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.725007 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.725154 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.725154 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.725451 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.725611 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.725807 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.725966 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.726120 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.726273 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.726868 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.727101 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.727264 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.727418 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.727573 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.727573 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.727862 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.728017 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.728163 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.728324 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.728470 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.728622 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.728783 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.729017 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.729166 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.729325 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.729479 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.729625 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.729795 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.729951 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.730105 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.730251 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.730395 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.730540 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.730694 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.730849 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.731015 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.731167 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.731324 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.731481 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.731701 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.731872 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.732020 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.732020 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.732020 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.732444 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.732600 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.732755 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.732910 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.733058 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.733211 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.733371 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.733523 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.733669 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.733827 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.733972 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.734125 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.734280 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.734470 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.734628 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.734783 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.734930 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.735128 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.735293 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.735448 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.735594 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.735751 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.735751 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.736036 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.736036 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.736334 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.736334 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.736654 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.737155 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.737320 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.737320 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.737625 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.737732 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.737821 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.737821 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.738024 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.738024 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.738281 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.738369 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.738544 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.738644 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.738742 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.738839 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.738925 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.739090 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.739190 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.739278 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.739376 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.739469 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.739555 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.739639 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.739722 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.739816 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.739902 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.739986 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.740068 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.740068 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.740230 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.740230 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.740509 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.740607 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.740701 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.740701 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.740853 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.740946 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.740946 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.741108 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.741200 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.741292 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.741389 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.741484 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.741582 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.741668 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.741759 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.741844 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.741936 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.742028 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.742028 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.742191 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.742274 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.742364 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.742459 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.742551 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.742637 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.742727 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.742819 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.742910 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.743034 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.743124 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.743219 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.743305 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.743396 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.743487 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.743585 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.743678 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.743763 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.743853 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.744021 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.744131 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.744347 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.744486 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.744670 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.744771 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.744983 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.745090 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.745307 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.745415 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.745622 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.745733 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.745941 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.746044 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.746246 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.746354 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.746560 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.746675 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.746916 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.766352 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.766538 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.766674 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.766829 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.767051 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.767314 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.767686 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.767880 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.768044 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.768205 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.768361 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.768542 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.768872 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.769216 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.769375 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.769529 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.770337 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.770518 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.770673 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.770843 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.771054 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.771224 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.771379 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.771541 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.771694 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.771848 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.772000 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.772160 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.772315 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.772476 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.772638 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.772800 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.772954 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.773127 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.773291 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.773452 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.773617 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.773770 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.773932 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.774093 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.774256 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.774418 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.774572 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.774732 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.774732 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.774732 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.774732 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.774732 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.774732 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.775757 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.775910 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.776062 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.776224 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.776386 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.776539 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.776704 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.776867 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.776867 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.777190 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.777482 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.778004 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.778178 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.778178 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.778497 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.778653 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.779048 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.779236 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.779520 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.779677 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.779849 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.779849 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.780167 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.780167 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.780616 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.780788 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.780954 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.781108 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.781262 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.781414 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.781575 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.781728 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.781891 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.782053 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.782207 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.782380 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.782534 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.782701 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.782863 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.783046 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.783207 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.783361 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.783521 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.783695 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.783857 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.784019 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.784172 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.784324 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.784489 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.784489 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.784489 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.784489 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.785130 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.785290 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.786006 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.786173 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.786327 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.786480 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.786639 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.786792 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.786958 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.787186 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.787339 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.787583 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.787756 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.788152 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.788328 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.788505 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.788505 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.788505 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.788505 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.789251 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.789427 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.789698 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.789872 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.790026 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.790190 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.790344 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.790506 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.790775 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.790946 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.791136 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.791292 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.791453 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.791607 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.791769 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.791934 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.792087 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.792249 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.792412 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.792632 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.792791 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.792945 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.793098 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.793250 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.793250 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.793568 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.793723 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.793876 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.794039 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.794199 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.794362 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.794523 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.794677 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.794838 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.795009 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.801207 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.801405 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.801581 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.801755 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.801925 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.802084 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.802265 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.802430 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.802593 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.802755 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.802910 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.803164 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.803333 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.803496 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.803650 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.803650 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.803949 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.804110 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.804289 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.804451 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.804612 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.804773 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.804773 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.805092 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.805246 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.805407 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.805567 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.805720 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.805872 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.806032 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.806193 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.806359 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.806521 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.806684 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.806849 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.807066 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.807245 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.807400 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.807574 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.807756 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.807922 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.808075 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.808226 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.808378 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.808552 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.809005 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.809174 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.809330 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.809489 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.809670 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.810004 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.810274 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.810434 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.810597 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.810752 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.810913 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.811144 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.811422 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.811581 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.811744 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.811916 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.812160 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.812317 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.812470 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.812630 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.812798 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.812963 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.813117 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.813277 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.813458 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.813620 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.813620 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.813932 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.814092 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.814253 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.814406 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.814578 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.814732 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.814893 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.815082 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.815237 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.815395 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.815569 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.815723 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.815876 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.816036 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.816188 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.816339 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.816505 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.817203 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.817359 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.817511 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.817674 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.817843 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.818008 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.818173 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.818326 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.818485 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.818639 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.818824 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.819302 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.819469 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.819639 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.819794 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.820073 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.820334 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.820590 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.820749 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.820922 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.821077 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.821077 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.821388 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.821662 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.821823 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.821977 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.822130 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.822282 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.822449 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.822612 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.822767 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.822937 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.823207 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.823377 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.823539 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.823693 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.823853 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.824020 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.824185 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.824348 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.824508 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.824661 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.824813 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.824965 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.825135 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.825305 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.825466 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.825620 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.825780 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.825933 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.826094 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.826262 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.826425 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.826579 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.826741 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.826902 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.827106 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.827273 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.827426 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.827579 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.827739 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.827900 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.828064 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.828226 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.828380 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.828540 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.828694 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.828855 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.829043 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.829469 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.829636 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.829789 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.829949 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.830194 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.830372 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.830532 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.830790 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.830983 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.831157 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.831325 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.831487 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.831670 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.831670 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.831998 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.831998 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.832324 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.832970 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.833107 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.833257 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.833402 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.833552 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.833705 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.833855 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.834006 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.834156 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.834308 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.834451 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.834603 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.834754 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.834903 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.835162 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.835323 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.835477 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.835624 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.835768 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.835910 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.836055 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.836160 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.836256 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.836342 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.836434 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.836532 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.836617 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.836702 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.836794 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.836890 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.836983 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.836983 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.836983 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.836983 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.836983 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.836983 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.836983 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.836983 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.837586 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.837586 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.837586 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.837586 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.837586 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.837586 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.837586 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.837586 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.838278 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.838372 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.838465 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.838555 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.838647 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.838741 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.838826 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.838910 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.839010 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.839097 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.839212 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.839586 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.839690 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.839792 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.839886 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.839978 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.840064 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.840182 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.840265 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.840336 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.840427 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.840513 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.840668 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.840756 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.840865 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.840940 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.841010 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.841093 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.841191 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.841284 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.841370 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.841460 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.841553 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.841644 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.841737 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.841824 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.841910 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.841983 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.842068 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.842153 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.842246 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.842333 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.842423 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.842508 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.842602 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.842707 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.842802 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.842889 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.843013 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.843105 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.843200 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.843300 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.843394 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.843479 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.843479 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.843631 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.843631 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.843631 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.844798 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.844903 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.845001 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.845088 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.845172 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.845276 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.845376 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.845470 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.845556 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.845647 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.845742 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.845829 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.845916 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.845995 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.846065 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.846142 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.846222 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.846301 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.846380 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.846457 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.846535 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.846619 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.846710 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.846796 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.846883 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.846992 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.847094 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.847182 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.847276 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.847362 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.847446 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.847446 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.847615 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.847714 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.847807 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.847926 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.848019 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.848104 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.848188 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.848282 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.848368 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.848451 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.848542 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.848627 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.848710 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.848710 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.848883 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.848883 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.849046 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.849138 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.849222 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.849222 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.849381 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.849634 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.849732 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.849826 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.849921 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.850013 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.850097 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.850190 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.850283 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.850365 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.850451 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.850537 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.850537 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.850690 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.850774 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.850858 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.850960 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.851082 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.851164 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.851256 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.851341 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.851437 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.851537 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.851632 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.851632 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.851795 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.851887 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.851982 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.852069 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.852142 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.852226 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.852309 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.852401 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.852497 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.852584 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.852676 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.852771 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.852870 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.852964 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.853050 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.853134 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.853217 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.853314 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.853409 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.853494 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.853579 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.853663 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.853754 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.853847 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.853847 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.854092 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.854185 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.854272 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.854355 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.854439 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.854536 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.854618 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.854690 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.854760 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.854837 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.854922 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.855014 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.855114 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.855201 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.855285 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.855376 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.855475 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.855570 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.855649 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.855722 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.855798 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.855798 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.855943 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.856016 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.856085 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.856177 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.856268 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.856341 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.856436 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.856522 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.856612 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.856697 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.856787 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.856880 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.856972 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.857066 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.857152 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.857235 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.857235 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.857235 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.857235 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.857535 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.857626 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.857712 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.857802 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.857897 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.857991 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.858084 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.858265 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.858430 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.858527 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.858623 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.858709 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.858792 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.858875 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.858958 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.859171 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.859316 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.859415 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.859540 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.859766 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.859861 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.859961 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.860056 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.860150 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.860150 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.860316 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.860408 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.860495 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.860495 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.860625 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.860715 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.860794 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.860866 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.860962 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.861048 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.861139 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.861275 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.861376 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.861472 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.861565 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.861650 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.861733 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.861823 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.861908 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.861999 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.862085 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.862175 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.862248 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.862325 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.862411 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.862507 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.862600 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.862686 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.862769 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.862858 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.862942 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.862942 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.863127 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.863201 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.863270 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.863270 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.863419 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.863419 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.863606 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.863693 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.863777 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.863867 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.863966 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.864053 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.864136 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.864218 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.864300 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.864391 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.864488 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.864573 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.864656 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.864739 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.864829 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.864924 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.865027 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.865027 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.865198 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.865284 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.865367 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.865458 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.865549 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.865634 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.865717 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.865799 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.865799 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.865962 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.866048 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.866137 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.866236 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.866330 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.866404 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.866487 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.866572 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.866661 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.866661 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.866824 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.866907 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.867024 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.867114 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.867205 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.867291 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.867382 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.867477 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.867569 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.867655 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.867738 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.867833 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.867918 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.868015 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.868109 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.868194 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.868278 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.868362 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.868445 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.868541 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.868628 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.868717 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.868801 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.868892 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.868986 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.869080 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.869180 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.869273 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.869273 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.869273 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.869516 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.869647 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.869755 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.869840 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.869920 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.870020 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.870106 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.870198 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.870290 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.870389 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.870482 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.870665 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.870762 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.870842 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.870919 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.871131 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.871243 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.871338 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.871413 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.871492 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.871584 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.871677 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.871772 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.871772 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.871944 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.872029 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.872113 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.872205 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.872304 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.872445 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.872548 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.872635 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.872727 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.872827 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.872922 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.873092 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.873369 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.873486 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.873690 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.873803 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.874070 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.874173 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.874361 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.874454 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.874677 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.874785 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.875628 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.875745 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.875745 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.875888 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.875972 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.876052 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.876125 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.876204 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.876284 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.876625 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.876734 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.876810 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.876880 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.877112 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.877212 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.877424 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.877536 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.877740 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.877831 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.878036 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.878125 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.878353 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.878455 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.878662 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.878760 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.878995 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.880438 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.880556 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.880651 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.880735 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.880813 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.880901 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.880983 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.881064 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.881137 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.881216 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.881518 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.881953 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.882042 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.882042 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.882192 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.882271 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.882349 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.882676 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.882774 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.882866 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.882949 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.883511 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.883741 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.883841 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.884051 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.884143 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.884359 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.884452 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.884671 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.884763 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.884980 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.885080 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.885286 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.885378 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.885598 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.885698 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.885900 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.886000 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.886227 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.886319 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.886534 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.886633 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.886828 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.886923 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.887317 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.887566 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.887675 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.887890 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.887996 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.888202 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.888299 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.888522 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.888621 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.888810 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.888903 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.889122 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.889224 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.889426 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.889524 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.889735 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.889833 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.890039 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.890152 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.890437 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.890532 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.890656 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.890747 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.891006 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.891109 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.891380 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.891522 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.891826 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.891906 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.891906 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.892046 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.892369 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.892473 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.892473 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.892604 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.892976 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.893086 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.893161 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.893243 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.893501 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.893597 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.893770 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.893861 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.894045 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.894151 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.894329 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.894421 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.894623 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.895447 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.895608 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.895833 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.895931 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.896151 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.896247 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.896490 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.896600 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.896805 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.896924 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.897180 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.897280 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.897469 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.897671 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.897777 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.898016 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.898125 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.898327 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.898432 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.898633 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.898728 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.898941 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.899066 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.899273 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.899385 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.899576 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.899671 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.899912 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.900019 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.900202 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.900599 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.900696 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.900771 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.900841 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.900910 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.901228 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.901332 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.901408 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.901486 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.902062 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.902164 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.902248 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.902329 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.902407 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.902478 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.903283 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.903391 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.903391 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.903625 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.903711 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.903783 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.903861 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.903938 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.904019 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.904092 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.904561 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.904656 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.904728 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.904814 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.905066 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.905159 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.905233 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.905325 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.905940 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.906052 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.906052 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.906185 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.906256 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.906333 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.906659 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.906767 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.906851 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.906924 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.907346 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.907438 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.907522 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.907596 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.907856 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.907959 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.908135 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.908227 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.908422 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.908524 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.908702 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.908794 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.909028 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.909134 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.909365 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.909463 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.909690 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.909854 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.910059 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.910239 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.910316 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.910416 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.910905 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.911040 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.911120 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.911348 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.911442 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.911525 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.911766 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.911878 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.912331 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.912431 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.912507 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.912763 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.912854 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.912926 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.912996 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.913076 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.913468 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.913651 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.913805 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.913957 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.914119 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.914279 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.914433 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.914592 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.914753 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.914906 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.915111 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.915283 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.915958 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.916131 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.916305 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.916459 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.916622 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.916783 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.916936 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.917089 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.917248 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.917497 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.917658 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.917819 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.917972 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.918123 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.918293 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.918457 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.918613 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.918765 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.918924 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.919103 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.919270 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.919434 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.919596 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.919749 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.919903 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.920062 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.920223 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.920396 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.920556 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.920931 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.921091 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.921244 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.921417 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.921572 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.921724 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.921877 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.922049 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.922346 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.922522 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.922703 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.923278 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.923444 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.923713 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.923874 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.924038 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.924192 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.924344 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.924496 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.924648 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.924809 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.924972 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.925137 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.925297 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.925458 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.925611 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.925773 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.925935 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.926126 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.926280 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.926431 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.926592 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.926759 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.926913 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.927093 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.927262 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.927415 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.927415 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 19 16:01:41.927812 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.927812 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.927812 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.927812 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.927812 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.927812 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.927812 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:01:41.928809 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 19 16:01:41.951916 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_db.sqlalchemy.engines [None req-848af06f-9d83-4d4a-802b-4d856c8d71fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 16:01:41.956908 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_db.sqlalchemy.engines [None req-a230d91c-8555-400a-9969-1b11c4f6c1c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 16:01:42.025889 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.context [None req-848af06f-9d83-4d4a-802b-4d856c8d71fc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),753ba822-f6b2-435f-a99e-73d7149d7f8d(cell1) {{(pid=128876) load_cells /opt/stack/nova/nova/context.py:464}} Jan 19 16:01:42.030212 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-848af06f-9d83-4d4a-802b-4d856c8d71fc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:01:42.031819 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-848af06f-9d83-4d4a-802b-4d856c8d71fc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:01:42.032088 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.context [None req-a230d91c-8555-400a-9969-1b11c4f6c1c3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),753ba822-f6b2-435f-a99e-73d7149d7f8d(cell1) {{(pid=128875) load_cells /opt/stack/nova/nova/context.py:464}} Jan 19 16:01:42.032649 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-848af06f-9d83-4d4a-802b-4d856c8d71fc None None] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:01:42.034602 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-848af06f-9d83-4d4a-802b-4d856c8d71fc None None] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:01:42.037169 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a230d91c-8555-400a-9969-1b11c4f6c1c3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:01:42.039202 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a230d91c-8555-400a-9969-1b11c4f6c1c3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:01:42.040261 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a230d91c-8555-400a-9969-1b11c4f6c1c3 None None] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:01:42.042454 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a230d91c-8555-400a-9969-1b11c4f6c1c3 None None] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:01:42.044804 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_db.sqlalchemy.engines [None req-848af06f-9d83-4d4a-802b-4d856c8d71fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 16:01:42.054013 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_db.sqlalchemy.engines [None req-a230d91c-8555-400a-9969-1b11c4f6c1c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 16:01:42.056628 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_db.sqlalchemy.engines [None req-848af06f-9d83-4d4a-802b-4d856c8d71fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 16:01:42.059796 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_db.sqlalchemy.engines [None req-a230d91c-8555-400a-9969-1b11c4f6c1c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 16:01:42.220674 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_db.sqlalchemy.engines [None req-848af06f-9d83-4d4a-802b-4d856c8d71fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 16:01:42.227703 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_db.sqlalchemy.engines [None req-a230d91c-8555-400a-9969-1b11c4f6c1c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 16:01:42.549101 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: WARNING keystonemiddleware.auth_token [None req-848af06f-9d83-4d4a-802b-4d856c8d71fc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 16:01:42.555267 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: WARNING keystonemiddleware.auth_token [None req-a230d91c-8555-400a-9969-1b11c4f6c1c3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 16:01:42.557014 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: WARNING keystonemiddleware.auth_token [None req-848af06f-9d83-4d4a-802b-4d856c8d71fc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 16:01:42.561756 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: WARNING keystonemiddleware.auth_token [None req-a230d91c-8555-400a-9969-1b11c4f6c1c3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 16:01:42.900945 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: WARNING keystonemiddleware.auth_token [None req-848af06f-9d83-4d4a-802b-4d856c8d71fc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 16:01:42.906234 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: WARNING keystonemiddleware.auth_token [None req-848af06f-9d83-4d4a-802b-4d856c8d71fc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 16:01:42.906681 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: WARNING keystonemiddleware.auth_token [None req-a230d91c-8555-400a-9969-1b11c4f6c1c3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 16:01:42.912209 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b20333a9c0 pid: 128876 (default app) Jan 19 16:01:42.912424 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: WARNING keystonemiddleware.auth_token [None req-a230d91c-8555-400a-9969-1b11c4f6c1c3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 16:01:42.917689 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b20333a9c0 pid: 128875 (default app) Jan 19 16:02:21.990087 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-34595281-0c6e-4296-ba0f-3b9b8f000451 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-24724459", "imageRef": "6d9c05bd-015a-44de-bd51-f744cb247e7a", "flavorRef": "452", "networks": [{"uuid": "d642b74e-4dc9-4613-8da6-c9feaf68b80d"}]}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:02:22.598502 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.network.neutron [None req-34595281-0c6e-4296-ba0f-3b9b8f000451 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] validate_networks() for [('d642b74e-4dc9-4613-8da6-c9feaf68b80d', None, None, None, None, None)] {{(pid=128876) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:02:22.842810 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-55547afe-297e-4f2a-8589-ba4e82975f2e tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-819256341", "imageRef": "6d9c05bd-015a-44de-bd51-f744cb247e7a", "flavorRef": "452", "networks": [{"uuid": "411cade2-a12d-4a41-b592-2238e11db1bf"}]}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:02:23.370325 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.network.neutron [None req-55547afe-297e-4f2a-8589-ba4e82975f2e tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] validate_networks() for [('411cade2-a12d-4a41-b592-2238e11db1bf', None, None, None, None, None)] {{(pid=128875) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:02:24.756178 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-34595281-0c6e-4296-ba0f-3b9b8f000451 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Flavor limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:02:24.756799 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-34595281-0c6e-4296-ba0f-3b9b8f000451 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Image limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:02:24.757067 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-34595281-0c6e-4296-ba0f-3b9b8f000451 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Flavor pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:02:24.757474 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-34595281-0c6e-4296-ba0f-3b9b8f000451 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Image pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:02:24.757928 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-34595281-0c6e-4296-ba0f-3b9b8f000451 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:02:24.791075 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-34595281-0c6e-4296-ba0f-3b9b8f000451 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:24.791520 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-34595281-0c6e-4296-ba0f-3b9b8f000451 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:24.797348 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-34595281-0c6e-4296-ba0f-3b9b8f000451 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:24.797826 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-34595281-0c6e-4296-ba0f-3b9b8f000451 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:24.847954 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-34595281-0c6e-4296-ba0f-3b9b8f000451 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Getting quotas for project a7e40e4efd974d37820bb6724978d22f. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:02:24.857704 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-34595281-0c6e-4296-ba0f-3b9b8f000451 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Getting quotas for user 3f7ace876fa34fe688d055a4a5fb1fdb and project a7e40e4efd974d37820bb6724978d22f. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:02:24.871328 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-34595281-0c6e-4296-ba0f-3b9b8f000451 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Going to run 1 instances... {{(pid=128876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:02:24.888557 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-34595281-0c6e-4296-ba0f-3b9b8f000451 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6d9c05bd-015a-44de-bd51-f744cb247e7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:02:24.889790 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-55547afe-297e-4f2a-8589-ba4e82975f2e tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Flavor limits 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:02:24.890301 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-55547afe-297e-4f2a-8589-ba4e82975f2e tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Image limits 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:02:24.890678 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-55547afe-297e-4f2a-8589-ba4e82975f2e tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Flavor pref 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:02:24.891137 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-55547afe-297e-4f2a-8589-ba4e82975f2e tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Image pref 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:02:24.891553 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-55547afe-297e-4f2a-8589-ba4e82975f2e tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:02:24.923076 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-55547afe-297e-4f2a-8589-ba4e82975f2e tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:24.923474 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-55547afe-297e-4f2a-8589-ba4e82975f2e tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:24.927306 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-55547afe-297e-4f2a-8589-ba4e82975f2e tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:24.929953 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-55547afe-297e-4f2a-8589-ba4e82975f2e tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:24.998940 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-55547afe-297e-4f2a-8589-ba4e82975f2e tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Getting quotas for project 521cd7bfd1864ee1bc299e6ee813329c. Resources: {'ram', 'cores', 'instances'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:02:25.006757 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-55547afe-297e-4f2a-8589-ba4e82975f2e tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Getting quotas for user 1ae404fe9ed1466f90772a58302157d4 and project 521cd7bfd1864ee1bc299e6ee813329c. Resources: {'ram', 'cores', 'instances'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:02:25.019936 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-55547afe-297e-4f2a-8589-ba4e82975f2e tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Going to run 1 instances... {{(pid=128875) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:02:25.023263 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-55547afe-297e-4f2a-8589-ba4e82975f2e tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6d9c05bd-015a-44de-bd51-f744cb247e7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:02:25.204076 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-55547afe-297e-4f2a-8589-ba4e82975f2e tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.138812 Jan 19 16:02:25.211357 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 1/1] 10.222.0.58 () {60 vars in 1146 bytes} [Wed Jan 19 16:02:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 3149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:02:25.218103 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-2ca2a700-64b3-4bae-b84f-34028aa84be4 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:25.219186 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-2ca2a700-64b3-4bae-b84f-34028aa84be4 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:25.220603 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-34595281-0c6e-4296-ba0f-3b9b8f000451 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.115199 Jan 19 16:02:25.221468 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 1/2] 10.222.0.58 () {60 vars in 1146 bytes} [Wed Jan 19 16:02:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 4117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:02:25.236814 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-fc408af5-3b43-435c-ab6e-dd2cb4ab9d35 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:25.241621 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-fc408af5-3b43-435c-ab6e-dd2cb4ab9d35 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:25.461198 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-2ca2a700-64b3-4bae-b84f-34028aa84be4 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:25.486210 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-2ca2a700-64b3-4bae-b84f-34028aa84be4 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1214 microversion: 2.1 time: 0.272712 Jan 19 16:02:25.498187 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 2/3] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:25 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1214 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:25.507488 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-fc408af5-3b43-435c-ab6e-dd2cb4ab9d35 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:25.531418 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-fc408af5-3b43-435c-ab6e-dd2cb4ab9d35 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1216 microversion: 2.1 time: 0.302481 Jan 19 16:02:25.536962 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 2/4] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:25 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1216 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:26.610925 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-7ec066bc-6856-4dc4-88b0-46c3612b0916 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:26.610925 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-7ec066bc-6856-4dc4-88b0-46c3612b0916 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:26.616282 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-348c01b7-ba51-479c-a512-50f11ed05b77 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:26.616282 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-348c01b7-ba51-479c-a512-50f11ed05b77 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:26.748139 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-7ec066bc-6856-4dc4-88b0-46c3612b0916 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:26.765678 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-7ec066bc-6856-4dc4-88b0-46c3612b0916 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1214 microversion: 2.1 time: 0.264855 Jan 19 16:02:26.772152 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 3/5] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:26 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1214 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:26.900302 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-348c01b7-ba51-479c-a512-50f11ed05b77 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:26.907404 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-348c01b7-ba51-479c-a512-50f11ed05b77 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1216 microversion: 2.1 time: 0.360349 Jan 19 16:02:26.933534 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 3/6] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:26 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1216 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:27.790298 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-b93277aa-e3a7-4c30-a2c1-80cd731ea7a1 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:27.792100 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-b93277aa-e3a7-4c30-a2c1-80cd731ea7a1 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:27.896003 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-b93277aa-e3a7-4c30-a2c1-80cd731ea7a1 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:27.903171 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-b93277aa-e3a7-4c30-a2c1-80cd731ea7a1 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1214 microversion: 2.1 time: 0.117285 Jan 19 16:02:27.906553 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 4/7] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:27 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:27.927740 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-bf078d44-e6ba-4e5b-8e61-6b48458e9540 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:27.929377 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-bf078d44-e6ba-4e5b-8e61-6b48458e9540 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:28.254445 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-bf078d44-e6ba-4e5b-8e61-6b48458e9540 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:28.269330 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-bf078d44-e6ba-4e5b-8e61-6b48458e9540 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1216 microversion: 2.1 time: 0.340872 Jan 19 16:02:28.272891 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 4/8] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:27 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1216 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:28.923693 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-b2ea06fc-0c72-416e-a4ea-d7306f780255 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:28.924586 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-b2ea06fc-0c72-416e-a4ea-d7306f780255 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:28.944066 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b2ea06fc-0c72-416e-a4ea-d7306f780255 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:28.944521 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b2ea06fc-0c72-416e-a4ea-d7306f780255 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:28.945338 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b2ea06fc-0c72-416e-a4ea-d7306f780255 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:28.950412 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b2ea06fc-0c72-416e-a4ea-d7306f780255 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:29.290832 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-36d0417a-ca00-4709-9098-473c960518e6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:29.291558 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-36d0417a-ca00-4709-9098-473c960518e6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:29.302200 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-36d0417a-ca00-4709-9098-473c960518e6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:29.302653 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-36d0417a-ca00-4709-9098-473c960518e6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:29.303482 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-36d0417a-ca00-4709-9098-473c960518e6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:29.310162 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-36d0417a-ca00-4709-9098-473c960518e6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:29.475597 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-b2ea06fc-0c72-416e-a4ea-d7306f780255 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:29.543713 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-b2ea06fc-0c72-416e-a4ea-d7306f780255 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1218 microversion: 2.1 time: 0.625231 Jan 19 16:02:29.554558 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 5/9] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:28 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1218 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:29.657579 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-36d0417a-ca00-4709-9098-473c960518e6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:29.704142 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-36d0417a-ca00-4709-9098-473c960518e6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1220 microversion: 2.1 time: 0.417981 Jan 19 16:02:29.706909 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 5/10] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:29 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1220 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:30.422795 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-aedc6d0a-29ef-451e-9323-969fa20fdb69 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'create', calling method: .version_select at 0x7feff5e5de50>, body: {"keypair": {"name": "tempest-keypair-1423543968"}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:02:30.470194 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-aedc6d0a-29ef-451e-9323-969fa20fdb69 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Getting quotas for project 803e4baba323417f977814e1d7250779. Resources: {'key_pairs'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:02:30.478755 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-aedc6d0a-29ef-451e-9323-969fa20fdb69 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Getting quotas for user b7085f779daa4cd6acf0b38a942d9c7c and project 803e4baba323417f977814e1d7250779. Resources: {'key_pairs'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:02:30.562469 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-0d270903-8507-4a38-859e-a93b5146b532 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:30.563868 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-0d270903-8507-4a38-859e-a93b5146b532 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:30.581009 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0d270903-8507-4a38-859e-a93b5146b532 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:30.581599 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0d270903-8507-4a38-859e-a93b5146b532 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:30.583489 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0d270903-8507-4a38-859e-a93b5146b532 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:30.586145 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0d270903-8507-4a38-859e-a93b5146b532 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:30.751674 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-0d270903-8507-4a38-859e-a93b5146b532 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:30.761645 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-0d270903-8507-4a38-859e-a93b5146b532 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1218 microversion: 2.1 time: 0.203516 Jan 19 16:02:30.764314 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 6/11] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:30 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1218 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:30.770309 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c18a7f52-17ca-4783-b4d1-554e0ac0141a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:30.771227 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c18a7f52-17ca-4783-b4d1-554e0ac0141a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:30.779417 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c18a7f52-17ca-4783-b4d1-554e0ac0141a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:30.780706 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-aedc6d0a-29ef-451e-9323-969fa20fdb69 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Getting quotas for project 803e4baba323417f977814e1d7250779. Resources: {'key_pairs'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:02:30.783812 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c18a7f52-17ca-4783-b4d1-554e0ac0141a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:30.788231 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-aedc6d0a-29ef-451e-9323-969fa20fdb69 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Getting quotas for user b7085f779daa4cd6acf0b38a942d9c7c and project 803e4baba323417f977814e1d7250779. Resources: {'key_pairs'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:02:30.789221 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c18a7f52-17ca-4783-b4d1-554e0ac0141a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:30.790767 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c18a7f52-17ca-4783-b4d1-554e0ac0141a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:30.823995 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-aedc6d0a-29ef-451e-9323-969fa20fdb69 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.602203 Jan 19 16:02:30.830168 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 6/12] 10.222.0.58 () {60 vars in 1157 bytes} [Wed Jan 19 16:02:30 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:31.205995 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c18a7f52-17ca-4783-b4d1-554e0ac0141a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:31.218649 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c18a7f52-17ca-4783-b4d1-554e0ac0141a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1220 microversion: 2.1 time: 0.451048 Jan 19 16:02:31.223713 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 7/13] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:30 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1220 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:31.783210 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-fbce7669-f9da-4f99-ac79-7fe2a59d2248 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:31.807986 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-fbce7669-f9da-4f99-ac79-7fe2a59d2248 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:31.807986 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fbce7669-f9da-4f99-ac79-7fe2a59d2248 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:31.807986 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fbce7669-f9da-4f99-ac79-7fe2a59d2248 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:31.807986 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fbce7669-f9da-4f99-ac79-7fe2a59d2248 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:31.808230 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fbce7669-f9da-4f99-ac79-7fe2a59d2248 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:32.025173 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-fbce7669-f9da-4f99-ac79-7fe2a59d2248 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:32.047969 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-fbce7669-f9da-4f99-ac79-7fe2a59d2248 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1218 microversion: 2.1 time: 0.269539 Jan 19 16:02:32.063023 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 7/14] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:31 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1218 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:32.241561 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-14db3bcc-9742-4694-90b2-4537bcbd76d9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:32.242216 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-14db3bcc-9742-4694-90b2-4537bcbd76d9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:32.251332 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-14db3bcc-9742-4694-90b2-4537bcbd76d9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:32.252514 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-14db3bcc-9742-4694-90b2-4537bcbd76d9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:32.253519 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-14db3bcc-9742-4694-90b2-4537bcbd76d9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:32.254163 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-14db3bcc-9742-4694-90b2-4537bcbd76d9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:32.400649 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-14db3bcc-9742-4694-90b2-4537bcbd76d9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:32.449332 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-14db3bcc-9742-4694-90b2-4537bcbd76d9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1220 microversion: 2.1 time: 0.210923 Jan 19 16:02:32.453067 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 8/15] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:32 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1220 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:33.083418 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-74561381-7f68-449e-8c76-6d88cb465f99 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:33.084510 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-74561381-7f68-449e-8c76-6d88cb465f99 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:33.106260 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-74561381-7f68-449e-8c76-6d88cb465f99 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:33.107152 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-74561381-7f68-449e-8c76-6d88cb465f99 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:33.108915 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-74561381-7f68-449e-8c76-6d88cb465f99 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:33.121613 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-74561381-7f68-449e-8c76-6d88cb465f99 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:33.426458 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-74561381-7f68-449e-8c76-6d88cb465f99 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:33.468581 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-74561381-7f68-449e-8c76-6d88cb465f99 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1218 microversion: 2.1 time: 0.391077 Jan 19 16:02:33.483813 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 8/16] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:33 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1218 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:33.498446 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-560d7b87-fd53-4276-8a40-43a22dca21e1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:33.501734 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-560d7b87-fd53-4276-8a40-43a22dca21e1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:33.529074 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-560d7b87-fd53-4276-8a40-43a22dca21e1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:33.529781 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-560d7b87-fd53-4276-8a40-43a22dca21e1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:33.531008 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-560d7b87-fd53-4276-8a40-43a22dca21e1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:33.534307 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-560d7b87-fd53-4276-8a40-43a22dca21e1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:33.717945 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-560d7b87-fd53-4276-8a40-43a22dca21e1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:33.747718 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-560d7b87-fd53-4276-8a40-43a22dca21e1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1220 microversion: 2.1 time: 0.258980 Jan 19 16:02:33.768000 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 9/17] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:33 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1220 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:33.779638 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-1b1420be-4b73-45d8-851c-43ebfb764798 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'create', calling method: .version_select at 0x7feff7917550>, body: {"keypair": {"name": "tempest-keypair-805844353"}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:02:33.853282 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-1b1420be-4b73-45d8-851c-43ebfb764798 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Getting quotas for project 349fd4b6edd347a09b8d1ded2f25a2dd. Resources: {'key_pairs'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:02:33.865171 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-1b1420be-4b73-45d8-851c-43ebfb764798 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Getting quotas for user b9abf8deacfc4edbb0a5585ea1fc7861 and project 349fd4b6edd347a09b8d1ded2f25a2dd. Resources: {'key_pairs'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:02:34.491496 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-cf0c8791-9ba6-448b-8267-cae976cd5afc tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:34.495167 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-cf0c8791-9ba6-448b-8267-cae976cd5afc tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:34.522025 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cf0c8791-9ba6-448b-8267-cae976cd5afc tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:34.525143 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-1b1420be-4b73-45d8-851c-43ebfb764798 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Getting quotas for project 349fd4b6edd347a09b8d1ded2f25a2dd. Resources: {'key_pairs'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:02:34.525449 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cf0c8791-9ba6-448b-8267-cae976cd5afc tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:34.525449 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cf0c8791-9ba6-448b-8267-cae976cd5afc tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:34.526775 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cf0c8791-9ba6-448b-8267-cae976cd5afc tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:34.536903 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-1b1420be-4b73-45d8-851c-43ebfb764798 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Getting quotas for user b9abf8deacfc4edbb0a5585ea1fc7861 and project 349fd4b6edd347a09b8d1ded2f25a2dd. Resources: {'key_pairs'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:02:34.568880 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-1b1420be-4b73-45d8-851c-43ebfb764798 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.480834 Jan 19 16:02:34.569669 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 9/18] 10.222.0.58 () {62 vars in 1198 bytes} [Wed Jan 19 16:02:33 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1483 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jan 19 16:02:34.780644 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a7b0313a-95c5-4a73-b4b4-940cfbc03e01 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:34.782054 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a7b0313a-95c5-4a73-b4b4-940cfbc03e01 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:34.792716 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a7b0313a-95c5-4a73-b4b4-940cfbc03e01 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:34.793811 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a7b0313a-95c5-4a73-b4b4-940cfbc03e01 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:34.795854 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a7b0313a-95c5-4a73-b4b4-940cfbc03e01 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:34.797426 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a7b0313a-95c5-4a73-b4b4-940cfbc03e01 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:34.818513 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-cf0c8791-9ba6-448b-8267-cae976cd5afc tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:34.828633 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-cf0c8791-9ba6-448b-8267-cae976cd5afc tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1266 microversion: 2.1 time: 0.345653 Jan 19 16:02:34.829233 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 10/19] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:34 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1266 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:02:35.069482 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a7b0313a-95c5-4a73-b4b4-940cfbc03e01 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:35.077899 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a7b0313a-95c5-4a73-b4b4-940cfbc03e01 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1268 microversion: 2.1 time: 0.302486 Jan 19 16:02:35.078487 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 10/20] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:34 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1268 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:35.712998 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-fc7867f3-0785-4e8d-9880-34aa00f6b09b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-435625389", "imageRef": "6d9c05bd-015a-44de-bd51-f744cb247e7a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20ddbffc-d1ef-4066-b7ae-b3abfef8e9f6"}]}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:02:35.835734 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.network.neutron [None req-fc7867f3-0785-4e8d-9880-34aa00f6b09b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] validate_networks() for [('20ddbffc-d1ef-4066-b7ae-b3abfef8e9f6', None, None, None, None, None)] {{(pid=128875) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:02:35.852130 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c8e27e40-5814-4d13-876c-f0f32a65152b tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:35.853690 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c8e27e40-5814-4d13-876c-f0f32a65152b tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:35.888294 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c8e27e40-5814-4d13-876c-f0f32a65152b tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:35.889943 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c8e27e40-5814-4d13-876c-f0f32a65152b tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:35.892602 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c8e27e40-5814-4d13-876c-f0f32a65152b tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:35.898907 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c8e27e40-5814-4d13-876c-f0f32a65152b tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:36.369551 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c8e27e40-5814-4d13-876c-f0f32a65152b tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:36.377434 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c8e27e40-5814-4d13-876c-f0f32a65152b tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1284 microversion: 2.1 time: 0.535353 Jan 19 16:02:36.381160 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 11/21] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:35 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1284 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:36.394942 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-038dbd72-c1fc-4303-8c0d-b010c5757637 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:36.396012 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-038dbd72-c1fc-4303-8c0d-b010c5757637 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:36.405971 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-038dbd72-c1fc-4303-8c0d-b010c5757637 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:36.413540 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-038dbd72-c1fc-4303-8c0d-b010c5757637 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:36.414833 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-038dbd72-c1fc-4303-8c0d-b010c5757637 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:36.425832 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-038dbd72-c1fc-4303-8c0d-b010c5757637 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:36.927936 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-038dbd72-c1fc-4303-8c0d-b010c5757637 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:36.935903 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-038dbd72-c1fc-4303-8c0d-b010c5757637 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1274 microversion: 2.1 time: 0.553495 Jan 19 16:02:36.936897 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 12/22] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:36 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1274 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:37.399189 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8beaed06-23ed-4d28-964c-567f7d3533b9 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:37.399828 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-8beaed06-23ed-4d28-964c-567f7d3533b9 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:37.417522 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8beaed06-23ed-4d28-964c-567f7d3533b9 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:37.418391 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8beaed06-23ed-4d28-964c-567f7d3533b9 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:37.418914 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8beaed06-23ed-4d28-964c-567f7d3533b9 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:37.424559 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8beaed06-23ed-4d28-964c-567f7d3533b9 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:37.695707 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-fc7867f3-0785-4e8d-9880-34aa00f6b09b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Flavor limits 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:02:37.700992 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-fc7867f3-0785-4e8d-9880-34aa00f6b09b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Image limits 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:02:37.701773 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-fc7867f3-0785-4e8d-9880-34aa00f6b09b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Flavor pref 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:02:37.702328 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-fc7867f3-0785-4e8d-9880-34aa00f6b09b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Image pref 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:02:37.709806 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-fc7867f3-0785-4e8d-9880-34aa00f6b09b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:02:37.743349 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fc7867f3-0785-4e8d-9880-34aa00f6b09b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:37.744501 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fc7867f3-0785-4e8d-9880-34aa00f6b09b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:37.755653 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fc7867f3-0785-4e8d-9880-34aa00f6b09b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:37.755852 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fc7867f3-0785-4e8d-9880-34aa00f6b09b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:37.828049 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-fc7867f3-0785-4e8d-9880-34aa00f6b09b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Getting quotas for project caa6825475c44bf698ffb6fe7c66195b. Resources: {'ram', 'cores', 'instances'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:02:37.839024 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-fc7867f3-0785-4e8d-9880-34aa00f6b09b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Getting quotas for user 19ed32130a254d9d84887c33e921be26 and project caa6825475c44bf698ffb6fe7c66195b. Resources: {'ram', 'cores', 'instances'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:02:37.947577 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-fc7867f3-0785-4e8d-9880-34aa00f6b09b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Going to run 1 instances... {{(pid=128875) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:02:37.955196 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-fc7867f3-0785-4e8d-9880-34aa00f6b09b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6d9c05bd-015a-44de-bd51-f744cb247e7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:02:37.987029 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8beaed06-23ed-4d28-964c-567f7d3533b9 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:38.004923 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-8beaed06-23ed-4d28-964c-567f7d3533b9 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1272 microversion: 2.1 time: 0.610077 Jan 19 16:02:38.051854 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 13/23] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:37 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1272 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:02:38.079122 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3d326815-a128-4f9b-8ecd-86aef1af9e8c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:38.080684 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3d326815-a128-4f9b-8ecd-86aef1af9e8c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:38.125137 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3d326815-a128-4f9b-8ecd-86aef1af9e8c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:38.140128 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3d326815-a128-4f9b-8ecd-86aef1af9e8c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:38.142675 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3d326815-a128-4f9b-8ecd-86aef1af9e8c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:38.149231 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3d326815-a128-4f9b-8ecd-86aef1af9e8c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:38.232994 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-fc7867f3-0785-4e8d-9880-34aa00f6b09b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.956781 Jan 19 16:02:38.244965 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 11/24] 10.222.0.58 () {60 vars in 1146 bytes} [Wed Jan 19 16:02:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 2969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:02:38.260411 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-283e0d42-69ec-4c10-9fb5-8c062ff87728 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1115742449", "imageRef": "6d9c05bd-015a-44de-bd51-f744cb247e7a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e34f37f-5aee-4573-8888-6ef1a085de00"}], "security_groups": [{"name": "tempest-securitygroup--579783918"}], "key_name": "tempest-keypair-1423543968", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:02:38.514192 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-3d326815-a128-4f9b-8ecd-86aef1af9e8c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:38.587972 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3d326815-a128-4f9b-8ecd-86aef1af9e8c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1274 microversion: 2.1 time: 0.532454 Jan 19 16:02:38.593429 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 14/25] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:38 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1274 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:38.651662 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-0b461e31-835a-4928-9ad2-3c032ed74a2e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:38.661362 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-0b461e31-835a-4928-9ad2-3c032ed74a2e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:39.006218 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.network.neutron [None req-283e0d42-69ec-4c10-9fb5-8c062ff87728 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] validate_networks() for [('4e34f37f-5aee-4573-8888-6ef1a085de00', None, None, None, None, None)] {{(pid=128875) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:02:39.070728 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-0b461e31-835a-4928-9ad2-3c032ed74a2e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:39.088958 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-0b461e31-835a-4928-9ad2-3c032ed74a2e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1221 microversion: 2.1 time: 0.492495 Jan 19 16:02:39.090031 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 15/26] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:38 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1221 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:39.128093 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b95753ed-7c11-4013-9fe4-7564da173b69 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:39.132930 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b95753ed-7c11-4013-9fe4-7564da173b69 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:39.161873 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b95753ed-7c11-4013-9fe4-7564da173b69 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:39.171225 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b95753ed-7c11-4013-9fe4-7564da173b69 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:39.173808 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b95753ed-7c11-4013-9fe4-7564da173b69 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:39.175202 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b95753ed-7c11-4013-9fe4-7564da173b69 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:39.812528 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-b95753ed-7c11-4013-9fe4-7564da173b69 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:39.832198 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b95753ed-7c11-4013-9fe4-7564da173b69 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1272 microversion: 2.1 time: 0.738456 Jan 19 16:02:39.842843 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 16/27] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:39 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1272 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:39.864596 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e077b916-5d81-45af-8728-19bb46b1bc33 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1654559628", "imageRef": "6d9c05bd-015a-44de-bd51-f744cb247e7a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20ddbffc-d1ef-4066-b7ae-b3abfef8e9f6"}]}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:02:40.220032 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.network.neutron [None req-e077b916-5d81-45af-8728-19bb46b1bc33 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] validate_networks() for [('20ddbffc-d1ef-4066-b7ae-b3abfef8e9f6', None, None, None, None, None)] {{(pid=128876) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:02:41.992168 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-283e0d42-69ec-4c10-9fb5-8c062ff87728 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Flavor limits 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:02:41.992961 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-283e0d42-69ec-4c10-9fb5-8c062ff87728 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Image limits 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:02:41.993857 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-283e0d42-69ec-4c10-9fb5-8c062ff87728 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Flavor pref 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:02:41.994624 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-283e0d42-69ec-4c10-9fb5-8c062ff87728 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Image pref 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:02:41.995516 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-283e0d42-69ec-4c10-9fb5-8c062ff87728 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:02:42.067413 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-283e0d42-69ec-4c10-9fb5-8c062ff87728 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:42.082685 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-283e0d42-69ec-4c10-9fb5-8c062ff87728 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:42.085038 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-283e0d42-69ec-4c10-9fb5-8c062ff87728 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:42.091330 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-283e0d42-69ec-4c10-9fb5-8c062ff87728 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:42.221186 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-283e0d42-69ec-4c10-9fb5-8c062ff87728 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Getting quotas for project 803e4baba323417f977814e1d7250779. Resources: {'ram', 'cores', 'instances'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:02:42.254456 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-283e0d42-69ec-4c10-9fb5-8c062ff87728 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Getting quotas for user b7085f779daa4cd6acf0b38a942d9c7c and project 803e4baba323417f977814e1d7250779. Resources: {'ram', 'cores', 'instances'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:02:42.298044 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-283e0d42-69ec-4c10-9fb5-8c062ff87728 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Going to run 1 instances... {{(pid=128875) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:02:42.304332 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-283e0d42-69ec-4c10-9fb5-8c062ff87728 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6d9c05bd-015a-44de-bd51-f744cb247e7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:02:42.516938 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-283e0d42-69ec-4c10-9fb5-8c062ff87728 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.268866 Jan 19 16:02:42.517932 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 12/28] 10.222.0.58 () {60 vars in 1146 bytes} [Wed Jan 19 16:02:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 4272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:02:42.532733 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-9d13ed15-d392-47c2-b264-8aafc196b2c0 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:42.536487 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-9d13ed15-d392-47c2-b264-8aafc196b2c0 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:42.558944 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9d13ed15-d392-47c2-b264-8aafc196b2c0 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:42.559434 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9d13ed15-d392-47c2-b264-8aafc196b2c0 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:42.560278 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9d13ed15-d392-47c2-b264-8aafc196b2c0 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:42.560758 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9d13ed15-d392-47c2-b264-8aafc196b2c0 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:44.187380 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-e077b916-5d81-45af-8728-19bb46b1bc33 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Flavor limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:02:44.188172 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-e077b916-5d81-45af-8728-19bb46b1bc33 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Image limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:02:44.189260 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-e077b916-5d81-45af-8728-19bb46b1bc33 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Flavor pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:02:44.190031 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-e077b916-5d81-45af-8728-19bb46b1bc33 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Image pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:02:44.191921 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-e077b916-5d81-45af-8728-19bb46b1bc33 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:02:44.243027 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-9d13ed15-d392-47c2-b264-8aafc196b2c0 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:44.245599 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e077b916-5d81-45af-8728-19bb46b1bc33 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:44.246656 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e077b916-5d81-45af-8728-19bb46b1bc33 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:44.250929 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e077b916-5d81-45af-8728-19bb46b1bc33 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:44.252080 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e077b916-5d81-45af-8728-19bb46b1bc33 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:44.280118 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-9d13ed15-d392-47c2-b264-8aafc196b2c0 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1316 microversion: 2.1 time: 1.760653 Jan 19 16:02:44.284236 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 13/29] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:42 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1316 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:44.333513 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-e077b916-5d81-45af-8728-19bb46b1bc33 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Getting quotas for project caa6825475c44bf698ffb6fe7c66195b. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:02:44.342872 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-bac8de26-b6b2-43a9-a204-786ef7a7eec5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:44.347151 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-bac8de26-b6b2-43a9-a204-786ef7a7eec5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:44.380074 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-e077b916-5d81-45af-8728-19bb46b1bc33 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Getting quotas for user 19ed32130a254d9d84887c33e921be26 and project caa6825475c44bf698ffb6fe7c66195b. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:02:44.386681 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bac8de26-b6b2-43a9-a204-786ef7a7eec5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:44.388271 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bac8de26-b6b2-43a9-a204-786ef7a7eec5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:44.392859 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bac8de26-b6b2-43a9-a204-786ef7a7eec5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:44.396235 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bac8de26-b6b2-43a9-a204-786ef7a7eec5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:44.418122 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-e077b916-5d81-45af-8728-19bb46b1bc33 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Going to run 1 instances... {{(pid=128876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:02:44.426037 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-e077b916-5d81-45af-8728-19bb46b1bc33 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6d9c05bd-015a-44de-bd51-f744cb247e7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:02:44.664530 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e077b916-5d81-45af-8728-19bb46b1bc33 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.820351 Jan 19 16:02:44.684678 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 17/30] 10.222.0.58 () {60 vars in 1146 bytes} [Wed Jan 19 16:02:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 4839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:02:44.697254 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-cd23fb07-2a83-4080-bbd6-fa24b17f56ed tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:44.698341 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-cd23fb07-2a83-4080-bbd6-fa24b17f56ed tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:44.721170 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cd23fb07-2a83-4080-bbd6-fa24b17f56ed tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:44.721846 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cd23fb07-2a83-4080-bbd6-fa24b17f56ed tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:44.722892 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cd23fb07-2a83-4080-bbd6-fa24b17f56ed tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:44.726474 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cd23fb07-2a83-4080-bbd6-fa24b17f56ed tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:45.129916 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-bac8de26-b6b2-43a9-a204-786ef7a7eec5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:45.164605 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-bac8de26-b6b2-43a9-a204-786ef7a7eec5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1314 microversion: 2.1 time: 0.878284 Jan 19 16:02:45.165568 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 14/31] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:44 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1314 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:45.170647 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ead26d74-91fa-46ee-b306-aff2246397b7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:45.171287 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-ead26d74-91fa-46ee-b306-aff2246397b7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:45.684054 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-cd23fb07-2a83-4080-bbd6-fa24b17f56ed tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:45.704401 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-cd23fb07-2a83-4080-bbd6-fa24b17f56ed tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1242 microversion: 2.1 time: 1.017361 Jan 19 16:02:45.706081 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 18/32] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:44 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1242 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:45.715921 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-970f7145-f9c6-48ef-a07f-80b3f3bd1170 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:45.716860 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-970f7145-f9c6-48ef-a07f-80b3f3bd1170 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:45.736515 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-970f7145-f9c6-48ef-a07f-80b3f3bd1170 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:45.737359 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-970f7145-f9c6-48ef-a07f-80b3f3bd1170 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:45.738465 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-970f7145-f9c6-48ef-a07f-80b3f3bd1170 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:45.746362 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-970f7145-f9c6-48ef-a07f-80b3f3bd1170 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:45.757528 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ead26d74-91fa-46ee-b306-aff2246397b7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:45.768682 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-ead26d74-91fa-46ee-b306-aff2246397b7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1222 microversion: 2.1 time: 0.601857 Jan 19 16:02:45.779434 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 15/33] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:45 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1222 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:46.194332 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-96548fb3-3709-487b-9d8f-7b5fea0cc5b5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:46.196079 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-96548fb3-3709-487b-9d8f-7b5fea0cc5b5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:46.213386 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-96548fb3-3709-487b-9d8f-7b5fea0cc5b5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:46.213903 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-96548fb3-3709-487b-9d8f-7b5fea0cc5b5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:46.214737 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-96548fb3-3709-487b-9d8f-7b5fea0cc5b5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:46.215264 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-96548fb3-3709-487b-9d8f-7b5fea0cc5b5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:46.830098 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-970f7145-f9c6-48ef-a07f-80b3f3bd1170 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:46.840408 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-970f7145-f9c6-48ef-a07f-80b3f3bd1170 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1316 microversion: 2.1 time: 1.128071 Jan 19 16:02:46.841804 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 19/34] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:45 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1316 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:46.941579 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-8d4f2065-2bea-42bf-9d9f-6f8b901a69c2 req-acd6aafe-d6ae-4bc7-aced-58dcb4672ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf8c20cd-e1b6-415c-9811-c58dbcf31b49", "tag": "eccf3abd-c626-40ae-a8b0-a9dcdf81545f"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:02:46.948372 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:02:46.948372 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:02:46.973813 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-8d4f2065-2bea-42bf-9d9f-6f8b901a69c2 req-acd6aafe-d6ae-4bc7-aced-58dcb4672ec1 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:46.976185 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-8d4f2065-2bea-42bf-9d9f-6f8b901a69c2 req-acd6aafe-d6ae-4bc7-aced-58dcb4672ec1 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:47.029777 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-8d4f2065-2bea-42bf-9d9f-6f8b901a69c2 req-acd6aafe-d6ae-4bc7-aced-58dcb4672ec1 service nova] Creating event network-changed:eccf3abd-c626-40ae-a8b0-a9dcdf81545f for instance cf8c20cd-e1b6-415c-9811-c58dbcf31b49 on hv-cinder-82002 Jan 19 16:02:47.030265 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-8d4f2065-2bea-42bf-9d9f-6f8b901a69c2 req-acd6aafe-d6ae-4bc7-aced-58dcb4672ec1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128876) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 19 16:02:47.032440 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-daaa7284-94be-4bbb-a1b2-c739ec4a903a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:47.032898 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-daaa7284-94be-4bbb-a1b2-c739ec4a903a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:47.033720 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-daaa7284-94be-4bbb-a1b2-c739ec4a903a None None] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:47.034150 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-daaa7284-94be-4bbb-a1b2-c739ec4a903a None None] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:47.052145 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.compute.rpcapi [None req-daaa7284-94be-4bbb-a1b2-c739ec4a903a None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 19 16:02:47.055029 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-daaa7284-94be-4bbb-a1b2-c739ec4a903a None None] Releasing lock "compute-rpcapi-router" {{(pid=128876) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 19 16:02:47.091656 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-daaa7284-94be-4bbb-a1b2-c739ec4a903a None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.247867 Jan 19 16:02:47.093093 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 20/35] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:02:47.115999 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-20acdb47-7832-4818-adf0-8f42fdc9bfba tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:47.117481 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-20acdb47-7832-4818-adf0-8f42fdc9bfba tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:47.141262 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-20acdb47-7832-4818-adf0-8f42fdc9bfba tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:47.142087 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-20acdb47-7832-4818-adf0-8f42fdc9bfba tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:47.143663 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-20acdb47-7832-4818-adf0-8f42fdc9bfba tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:47.145079 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-20acdb47-7832-4818-adf0-8f42fdc9bfba tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:47.598368 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-20acdb47-7832-4818-adf0-8f42fdc9bfba tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:47.629572 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-20acdb47-7832-4818-adf0-8f42fdc9bfba tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1308 microversion: 2.1 time: 0.534475 Jan 19 16:02:47.649110 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 21/36] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:47 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1308 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:47.670186 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-cd22e607-3f5d-41cd-b8f4-306cd472f5f5 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:47.671907 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-cd22e607-3f5d-41cd-b8f4-306cd472f5f5 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:47.682004 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-96548fb3-3709-487b-9d8f-7b5fea0cc5b5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:47.692385 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-96548fb3-3709-487b-9d8f-7b5fea0cc5b5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1314 microversion: 2.1 time: 1.502338 Jan 19 16:02:47.703128 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 16/37] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:46 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1314 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:47.707993 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cd22e607-3f5d-41cd-b8f4-306cd472f5f5 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:47.707993 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cd22e607-3f5d-41cd-b8f4-306cd472f5f5 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:47.707993 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cd22e607-3f5d-41cd-b8f4-306cd472f5f5 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:47.707993 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cd22e607-3f5d-41cd-b8f4-306cd472f5f5 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:47.863408 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-8ec496ac-547f-4610-aa65-a066bc5384fa tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:47.868957 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8ec496ac-547f-4610-aa65-a066bc5384fa tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:47.892975 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8ec496ac-547f-4610-aa65-a066bc5384fa tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:47.896455 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8ec496ac-547f-4610-aa65-a066bc5384fa tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:47.899343 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8ec496ac-547f-4610-aa65-a066bc5384fa tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:47.900651 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8ec496ac-547f-4610-aa65-a066bc5384fa tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:48.090202 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-cd22e607-3f5d-41cd-b8f4-306cd472f5f5 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:48.108743 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-cd22e607-3f5d-41cd-b8f4-306cd472f5f5 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1274 microversion: 2.1 time: 0.445784 Jan 19 16:02:48.116204 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 22/38] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:47 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1274 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:48.668587 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a25c8e55-6639-4ef9-8ab2-a0e220061f89 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:48.669850 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a25c8e55-6639-4ef9-8ab2-a0e220061f89 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:48.696955 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a25c8e55-6639-4ef9-8ab2-a0e220061f89 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:48.699828 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a25c8e55-6639-4ef9-8ab2-a0e220061f89 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:48.703026 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a25c8e55-6639-4ef9-8ab2-a0e220061f89 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:48.717861 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a25c8e55-6639-4ef9-8ab2-a0e220061f89 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:48.953181 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a25c8e55-6639-4ef9-8ab2-a0e220061f89 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:48.965156 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a25c8e55-6639-4ef9-8ab2-a0e220061f89 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1296 microversion: 2.1 time: 0.303599 Jan 19 16:02:48.979168 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 23/39] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:48 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1296 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:48.986116 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-69f9c862-076b-41f9-a525-afd3235bd9d2 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:48.986824 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-69f9c862-076b-41f9-a525-afd3235bd9d2 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:48.995427 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-69f9c862-076b-41f9-a525-afd3235bd9d2 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:48.996297 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-69f9c862-076b-41f9-a525-afd3235bd9d2 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:48.997712 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-69f9c862-076b-41f9-a525-afd3235bd9d2 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:48.999395 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-69f9c862-076b-41f9-a525-afd3235bd9d2 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:49.224255 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8ec496ac-547f-4610-aa65-a066bc5384fa tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:49.237152 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-8ec496ac-547f-4610-aa65-a066bc5384fa tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1316 microversion: 2.1 time: 1.382585 Jan 19 16:02:49.237797 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 17/40] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:47 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1316 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:02:49.249898 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-907e06db-26c0-4032-862a-83d07d5a00ea tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:49.270606 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-907e06db-26c0-4032-862a-83d07d5a00ea tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:49.314633 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-907e06db-26c0-4032-862a-83d07d5a00ea tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:49.317838 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-907e06db-26c0-4032-862a-83d07d5a00ea tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:49.319981 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-907e06db-26c0-4032-862a-83d07d5a00ea tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:49.321114 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-907e06db-26c0-4032-862a-83d07d5a00ea tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:49.535990 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-907e06db-26c0-4032-862a-83d07d5a00ea tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:49.564871 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-907e06db-26c0-4032-862a-83d07d5a00ea tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1280 microversion: 2.1 time: 0.318449 Jan 19 16:02:49.566776 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 18/41] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:49 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1280 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:50.069614 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-2d66e243-8d9c-4897-b7cc-bb1af805e5e0 req-af67ab86-1589-4394-a1b3-3d09fc010ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d843b329-8449-4eb9-9d5b-a12764773e75", "tag": "0c10b593-ffa7-45ab-aae4-22eb81766637"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:02:50.071948 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:02:50.071948 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:02:50.098479 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-2d66e243-8d9c-4897-b7cc-bb1af805e5e0 req-af67ab86-1589-4394-a1b3-3d09fc010ec7 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:50.099216 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-2d66e243-8d9c-4897-b7cc-bb1af805e5e0 req-af67ab86-1589-4394-a1b3-3d09fc010ec7 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:50.141084 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-2d66e243-8d9c-4897-b7cc-bb1af805e5e0 req-af67ab86-1589-4394-a1b3-3d09fc010ec7 service nova] Creating event network-changed:0c10b593-ffa7-45ab-aae4-22eb81766637 for instance d843b329-8449-4eb9-9d5b-a12764773e75 on hv-cinder-82002 Jan 19 16:02:50.141680 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-2d66e243-8d9c-4897-b7cc-bb1af805e5e0 req-af67ab86-1589-4394-a1b3-3d09fc010ec7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 19 16:02:50.142869 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-55af3e93-0e03-4d18-86a8-e98d99dec42d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:50.144200 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-55af3e93-0e03-4d18-86a8-e98d99dec42d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:50.145049 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-55af3e93-0e03-4d18-86a8-e98d99dec42d None None] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:50.147272 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-55af3e93-0e03-4d18-86a8-e98d99dec42d None None] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:50.176535 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.compute.rpcapi [None req-55af3e93-0e03-4d18-86a8-e98d99dec42d None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 19 16:02:50.177447 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-55af3e93-0e03-4d18-86a8-e98d99dec42d None None] Releasing lock "compute-rpcapi-router" {{(pid=128875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 19 16:02:50.240741 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-55af3e93-0e03-4d18-86a8-e98d99dec42d None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.370846 Jan 19 16:02:50.241697 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 19/42] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:02:50.247379 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-70742ae8-6112-4a70-9dfa-be7b98c9c8ce tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:50.248326 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-70742ae8-6112-4a70-9dfa-be7b98c9c8ce tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:50.265194 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-70742ae8-6112-4a70-9dfa-be7b98c9c8ce tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:50.267369 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-70742ae8-6112-4a70-9dfa-be7b98c9c8ce tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:50.271866 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-70742ae8-6112-4a70-9dfa-be7b98c9c8ce tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:50.272268 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-70742ae8-6112-4a70-9dfa-be7b98c9c8ce tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:50.597418 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-69f9c862-076b-41f9-a525-afd3235bd9d2 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:50.611923 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-69f9c862-076b-41f9-a525-afd3235bd9d2 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1314 microversion: 2.1 time: 1.631056 Jan 19 16:02:50.616922 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 24/43] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:48 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1314 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:50.626934 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f2d19cfe-4e0f-42ea-bfab-a9b711e453c9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:50.636518 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f2d19cfe-4e0f-42ea-bfab-a9b711e453c9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:50.637432 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-70742ae8-6112-4a70-9dfa-be7b98c9c8ce tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:50.644660 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f2d19cfe-4e0f-42ea-bfab-a9b711e453c9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:50.645103 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f2d19cfe-4e0f-42ea-bfab-a9b711e453c9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:50.649205 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f2d19cfe-4e0f-42ea-bfab-a9b711e453c9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:50.649205 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f2d19cfe-4e0f-42ea-bfab-a9b711e453c9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:50.653884 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-70742ae8-6112-4a70-9dfa-be7b98c9c8ce tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1296 microversion: 2.1 time: 0.410812 Jan 19 16:02:50.663585 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 20/44] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:50 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1296 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:50.672759 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-24b2d8ea-f0d7-444a-8b46-27df82e78ae0 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:50.673386 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-24b2d8ea-f0d7-444a-8b46-27df82e78ae0 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:50.693345 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-24b2d8ea-f0d7-444a-8b46-27df82e78ae0 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:50.694914 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-24b2d8ea-f0d7-444a-8b46-27df82e78ae0 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:50.694914 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-24b2d8ea-f0d7-444a-8b46-27df82e78ae0 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:50.695231 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-24b2d8ea-f0d7-444a-8b46-27df82e78ae0 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:50.815989 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-24b2d8ea-f0d7-444a-8b46-27df82e78ae0 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:50.833442 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-24b2d8ea-f0d7-444a-8b46-27df82e78ae0 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1280 microversion: 2.1 time: 0.168618 Jan 19 16:02:50.834397 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 21/45] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:50 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1280 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:51.663446 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-8c9e96e2-efda-4d66-afa1-c1a995e53fa9 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:51.673288 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8c9e96e2-efda-4d66-afa1-c1a995e53fa9 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:51.752734 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8c9e96e2-efda-4d66-afa1-c1a995e53fa9 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:51.758101 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8c9e96e2-efda-4d66-afa1-c1a995e53fa9 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:51.763654 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8c9e96e2-efda-4d66-afa1-c1a995e53fa9 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:51.768086 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8c9e96e2-efda-4d66-afa1-c1a995e53fa9 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:51.906956 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f2d19cfe-4e0f-42ea-bfab-a9b711e453c9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:51.949809 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f2d19cfe-4e0f-42ea-bfab-a9b711e453c9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1316 microversion: 2.1 time: 1.331227 Jan 19 16:02:51.956486 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 25/46] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:50 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1316 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:51.990177 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e3d54d97-4644-4547-a1ae-c6a833e5e84c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:51.992946 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-e3d54d97-4644-4547-a1ae-c6a833e5e84c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:52.032273 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e3d54d97-4644-4547-a1ae-c6a833e5e84c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:52.033735 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e3d54d97-4644-4547-a1ae-c6a833e5e84c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:52.035879 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e3d54d97-4644-4547-a1ae-c6a833e5e84c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:52.037148 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e3d54d97-4644-4547-a1ae-c6a833e5e84c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:52.819483 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8c9e96e2-efda-4d66-afa1-c1a995e53fa9 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:52.827930 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-8c9e96e2-efda-4d66-afa1-c1a995e53fa9 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1314 microversion: 2.1 time: 1.194233 Jan 19 16:02:52.828586 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 22/47] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:51 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1314 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:52.844479 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-73957a55-01f5-431a-87cb-cf4e820d143c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:52.845382 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-73957a55-01f5-431a-87cb-cf4e820d143c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:52.863498 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-73957a55-01f5-431a-87cb-cf4e820d143c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:52.864306 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-73957a55-01f5-431a-87cb-cf4e820d143c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:52.865303 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-73957a55-01f5-431a-87cb-cf4e820d143c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:52.865903 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-73957a55-01f5-431a-87cb-cf4e820d143c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:53.015609 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-73957a55-01f5-431a-87cb-cf4e820d143c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:53.028050 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-73957a55-01f5-431a-87cb-cf4e820d143c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1280 microversion: 2.1 time: 0.187268 Jan 19 16:02:53.032227 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 23/48] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:52 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1280 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:53.065410 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-ee288f8d-afa6-472f-83c5-908424684356 req-a23f3f22-0613-405f-a440-499be7288caa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "808abc0b-bb27-496f-8ce0-d536ab3d1ffb", "tag": "25aa7996-bdd0-49c3-bda2-801229048370"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:02:53.084860 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:02:53.084860 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:02:53.097834 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-ee288f8d-afa6-472f-83c5-908424684356 req-a23f3f22-0613-405f-a440-499be7288caa service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:53.098792 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-ee288f8d-afa6-472f-83c5-908424684356 req-a23f3f22-0613-405f-a440-499be7288caa service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:53.166074 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-ee288f8d-afa6-472f-83c5-908424684356 req-a23f3f22-0613-405f-a440-499be7288caa service nova] Creating event network-changed:25aa7996-bdd0-49c3-bda2-801229048370 for instance 808abc0b-bb27-496f-8ce0-d536ab3d1ffb on hv-cinder-82002 Jan 19 16:02:53.188417 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-ee288f8d-afa6-472f-83c5-908424684356 req-a23f3f22-0613-405f-a440-499be7288caa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145800 Jan 19 16:02:53.192755 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 24/49] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:02:53.194557 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-1b3dc9a2-1cc7-48a0-a49a-d01cffe21ef2 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:53.195525 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-1b3dc9a2-1cc7-48a0-a49a-d01cffe21ef2 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:53.212803 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1b3dc9a2-1cc7-48a0-a49a-d01cffe21ef2 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:53.213694 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1b3dc9a2-1cc7-48a0-a49a-d01cffe21ef2 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:53.215473 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1b3dc9a2-1cc7-48a0-a49a-d01cffe21ef2 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:53.216112 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1b3dc9a2-1cc7-48a0-a49a-d01cffe21ef2 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:53.247032 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e3d54d97-4644-4547-a1ae-c6a833e5e84c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:53.269253 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e3d54d97-4644-4547-a1ae-c6a833e5e84c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1363 microversion: 2.1 time: 1.308272 Jan 19 16:02:53.278578 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 26/50] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:51 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1363 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:53.300953 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3707818e-ed8e-461a-affb-3815035d97be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-22002410", "imageRef": "6d9c05bd-015a-44de-bd51-f744cb247e7a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "abe499d5-f64b-4529-88b6-f40c0516e98e"}], "security_groups": [{"name": "tempest-securitygroup--553313008"}], "key_name": "tempest-keypair-805844353", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:02:53.954556 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.network.neutron [None req-3707818e-ed8e-461a-affb-3815035d97be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] validate_networks() for [('abe499d5-f64b-4529-88b6-f40c0516e98e', None, None, None, None, None)] {{(pid=128876) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:02:54.317062 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-1b3dc9a2-1cc7-48a0-a49a-d01cffe21ef2 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:54.325571 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-1b3dc9a2-1cc7-48a0-a49a-d01cffe21ef2 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1316 microversion: 2.1 time: 1.135102 Jan 19 16:02:54.328689 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 25/51] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:53 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1316 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:54.335055 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-137057c7-8b1d-45ac-aa39-8d9e8b4a0f0d tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:54.348363 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-137057c7-8b1d-45ac-aa39-8d9e8b4a0f0d tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:54.365084 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-137057c7-8b1d-45ac-aa39-8d9e8b4a0f0d tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:54.365894 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-137057c7-8b1d-45ac-aa39-8d9e8b4a0f0d tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:54.367045 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-137057c7-8b1d-45ac-aa39-8d9e8b4a0f0d tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:54.367736 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-137057c7-8b1d-45ac-aa39-8d9e8b4a0f0d tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:55.254952 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-137057c7-8b1d-45ac-aa39-8d9e8b4a0f0d tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:55.301256 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-137057c7-8b1d-45ac-aa39-8d9e8b4a0f0d tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1314 microversion: 2.1 time: 0.970084 Jan 19 16:02:55.302264 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 26/52] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:54 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1314 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:55.382533 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-b47d79c5-a472-476f-9a3c-b9278b742a51 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:55.382533 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-b47d79c5-a472-476f-9a3c-b9278b742a51 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:55.382533 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b47d79c5-a472-476f-9a3c-b9278b742a51 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:55.382533 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b47d79c5-a472-476f-9a3c-b9278b742a51 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:55.383335 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b47d79c5-a472-476f-9a3c-b9278b742a51 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:55.383335 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b47d79c5-a472-476f-9a3c-b9278b742a51 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:55.564464 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-b47d79c5-a472-476f-9a3c-b9278b742a51 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:55.574244 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-b47d79c5-a472-476f-9a3c-b9278b742a51 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1322 microversion: 2.1 time: 0.270396 Jan 19 16:02:55.575122 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 27/53] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:55 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:55.581882 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-fff6c96b-6eba-4af7-b339-df1434e1d455 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:55.582834 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-fff6c96b-6eba-4af7-b339-df1434e1d455 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:55.591644 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fff6c96b-6eba-4af7-b339-df1434e1d455 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:55.592195 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fff6c96b-6eba-4af7-b339-df1434e1d455 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:55.593088 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fff6c96b-6eba-4af7-b339-df1434e1d455 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:55.593608 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fff6c96b-6eba-4af7-b339-df1434e1d455 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:55.720480 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-3707818e-ed8e-461a-affb-3815035d97be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Flavor limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:02:55.721187 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-3707818e-ed8e-461a-affb-3815035d97be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Image limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:02:55.721528 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-3707818e-ed8e-461a-affb-3815035d97be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Flavor pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:02:55.722519 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-3707818e-ed8e-461a-affb-3815035d97be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Image pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:02:55.722928 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-3707818e-ed8e-461a-affb-3815035d97be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:02:55.734305 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3707818e-ed8e-461a-affb-3815035d97be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:55.734932 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3707818e-ed8e-461a-affb-3815035d97be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:55.736105 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3707818e-ed8e-461a-affb-3815035d97be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:55.736686 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3707818e-ed8e-461a-affb-3815035d97be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:55.763934 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-3707818e-ed8e-461a-affb-3815035d97be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Getting quotas for project 349fd4b6edd347a09b8d1ded2f25a2dd. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:02:55.775776 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-3707818e-ed8e-461a-affb-3815035d97be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Getting quotas for user b9abf8deacfc4edbb0a5585ea1fc7861 and project 349fd4b6edd347a09b8d1ded2f25a2dd. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:02:55.804679 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3707818e-ed8e-461a-affb-3815035d97be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Going to run 1 instances... {{(pid=128876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:02:55.809249 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3707818e-ed8e-461a-affb-3815035d97be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6d9c05bd-015a-44de-bd51-f744cb247e7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:02:55.939930 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-fff6c96b-6eba-4af7-b339-df1434e1d455 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:55.956677 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-fff6c96b-6eba-4af7-b339-df1434e1d455 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1363 microversion: 2.1 time: 0.379582 Jan 19 16:02:55.971564 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 28/54] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:55 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1363 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:55.985420 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-12f264fe-bc72-46f5-a092-1cc6f6d71327 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:55.987021 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-12f264fe-bc72-46f5-a092-1cc6f6d71327 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:56.000543 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-12f264fe-bc72-46f5-a092-1cc6f6d71327 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:56.001677 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-12f264fe-bc72-46f5-a092-1cc6f6d71327 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:56.004513 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-12f264fe-bc72-46f5-a092-1cc6f6d71327 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:56.005609 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-12f264fe-bc72-46f5-a092-1cc6f6d71327 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:56.039794 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3707818e-ed8e-461a-affb-3815035d97be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.754832 Jan 19 16:02:56.041338 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 27/55] 10.222.0.58 () {62 vars in 1187 bytes} [Wed Jan 19 16:02:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 2760 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 19 16:02:56.053143 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-7e3a1b71-8c94-4dc8-bfd1-d14c5bae1933 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:56.053979 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-7e3a1b71-8c94-4dc8-bfd1-d14c5bae1933 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:56.519730 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-7e3a1b71-8c94-4dc8-bfd1-d14c5bae1933 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:56.538249 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-7e3a1b71-8c94-4dc8-bfd1-d14c5bae1933 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:56.547491 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-7e3a1b71-8c94-4dc8-bfd1-d14c5bae1933 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:56.549065 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-7e3a1b71-8c94-4dc8-bfd1-d14c5bae1933 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1279 microversion: 2.20 time: 0.501007 Jan 19 16:02:56.550816 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 28/56] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:02:56 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1279 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:02:56.556649 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-398139eb-7277-4456-a49b-ef308c702020 req-42eb634a-9d3a-47c5-ab66-751751f43af8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a", "tag": "c7242af9-f303-413b-adb2-3e898621610a"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:02:56.558928 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:02:56.558928 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:02:56.569757 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-398139eb-7277-4456-a49b-ef308c702020 req-42eb634a-9d3a-47c5-ab66-751751f43af8 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:56.570494 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-398139eb-7277-4456-a49b-ef308c702020 req-42eb634a-9d3a-47c5-ab66-751751f43af8 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:56.613733 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-398139eb-7277-4456-a49b-ef308c702020 req-42eb634a-9d3a-47c5-ab66-751751f43af8 service nova] Creating event network-changed:c7242af9-f303-413b-adb2-3e898621610a for instance a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a on hv-cinder-82002 Jan 19 16:02:56.621941 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-398139eb-7277-4456-a49b-ef308c702020 req-42eb634a-9d3a-47c5-ab66-751751f43af8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069040 Jan 19 16:02:56.623527 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 29/57] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:02:56.633904 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-1330791b-24a3-4f19-894f-84d1fadafe56 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:56.635037 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-1330791b-24a3-4f19-894f-84d1fadafe56 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:56.648970 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1330791b-24a3-4f19-894f-84d1fadafe56 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:56.650147 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1330791b-24a3-4f19-894f-84d1fadafe56 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:56.651542 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1330791b-24a3-4f19-894f-84d1fadafe56 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:56.652638 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1330791b-24a3-4f19-894f-84d1fadafe56 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:56.775344 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-12f264fe-bc72-46f5-a092-1cc6f6d71327 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:56.793790 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-12f264fe-bc72-46f5-a092-1cc6f6d71327 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1316 microversion: 2.1 time: 0.819291 Jan 19 16:02:56.794951 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 29/58] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:55 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1316 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:56.810089 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-4714f551-e7b3-427a-82f9-b4d539a45f83 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:56.814090 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-4714f551-e7b3-427a-82f9-b4d539a45f83 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:56.851138 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4714f551-e7b3-427a-82f9-b4d539a45f83 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:56.851138 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4714f551-e7b3-427a-82f9-b4d539a45f83 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:56.851357 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4714f551-e7b3-427a-82f9-b4d539a45f83 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:56.851724 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4714f551-e7b3-427a-82f9-b4d539a45f83 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:57.017047 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-1330791b-24a3-4f19-894f-84d1fadafe56 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:57.026256 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-1330791b-24a3-4f19-894f-84d1fadafe56 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1314 microversion: 2.1 time: 0.400143 Jan 19 16:02:57.038219 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 30/59] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:56 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:57.051676 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5a24bf2d-0c6d-4f97-8b66-d182f84747fb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:57.053326 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5a24bf2d-0c6d-4f97-8b66-d182f84747fb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:57.066084 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5a24bf2d-0c6d-4f97-8b66-d182f84747fb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:57.069849 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5a24bf2d-0c6d-4f97-8b66-d182f84747fb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:57.081364 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5a24bf2d-0c6d-4f97-8b66-d182f84747fb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:57.082125 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5a24bf2d-0c6d-4f97-8b66-d182f84747fb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:57.267507 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5a24bf2d-0c6d-4f97-8b66-d182f84747fb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:57.280198 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5a24bf2d-0c6d-4f97-8b66-d182f84747fb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1363 microversion: 2.1 time: 0.240347 Jan 19 16:02:57.281696 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 31/60] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:57 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:57.287781 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-b839f345-c07d-4c2e-853d-6abe3ffec2bd req-08699869-4155-459d-b6c9-824e39429eea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eafd976-e41c-44be-8b8e-358dd69f371d", "tag": "249b2651-5483-475a-b81d-a745b21a7e43"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:02:57.289781 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:02:57.289781 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:02:57.299156 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-b839f345-c07d-4c2e-853d-6abe3ffec2bd req-08699869-4155-459d-b6c9-824e39429eea service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:57.300897 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-b839f345-c07d-4c2e-853d-6abe3ffec2bd req-08699869-4155-459d-b6c9-824e39429eea service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:57.326538 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-b839f345-c07d-4c2e-853d-6abe3ffec2bd req-08699869-4155-459d-b6c9-824e39429eea service nova] Creating event network-changed:249b2651-5483-475a-b81d-a745b21a7e43 for instance 4eafd976-e41c-44be-8b8e-358dd69f371d on hv-cinder-82002 Jan 19 16:02:57.335785 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-b839f345-c07d-4c2e-853d-6abe3ffec2bd req-08699869-4155-459d-b6c9-824e39429eea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052986 Jan 19 16:02:57.336412 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 32/61] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:02:57.383996 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-4714f551-e7b3-427a-82f9-b4d539a45f83 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:57.392309 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-4714f551-e7b3-427a-82f9-b4d539a45f83 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1322 microversion: 2.1 time: 0.594261 Jan 19 16:02:57.393116 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 30/62] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:56 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1322 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:57.571183 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-1504f418-e0f4-4915-84fe-27d164b95096 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:57.572034 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-1504f418-e0f4-4915-84fe-27d164b95096 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:57.672793 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-1504f418-e0f4-4915-84fe-27d164b95096 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:57.683052 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-1504f418-e0f4-4915-84fe-27d164b95096 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:57.687485 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-1504f418-e0f4-4915-84fe-27d164b95096 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:57.691495 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-1504f418-e0f4-4915-84fe-27d164b95096 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1279 microversion: 2.20 time: 0.123947 Jan 19 16:02:57.707893 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 33/63] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:02:57 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1279 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:02:57.815861 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-fb3492f2-724d-4fea-b891-870b5318e037 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:57.816687 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-fb3492f2-724d-4fea-b891-870b5318e037 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:57.823336 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fb3492f2-724d-4fea-b891-870b5318e037 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:57.823960 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fb3492f2-724d-4fea-b891-870b5318e037 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:57.824767 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fb3492f2-724d-4fea-b891-870b5318e037 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:57.825406 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fb3492f2-724d-4fea-b891-870b5318e037 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:58.044510 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-15ac1be5-0231-46e3-8ab3-a013a0f403bc tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:58.045314 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-15ac1be5-0231-46e3-8ab3-a013a0f403bc tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:58.060497 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-15ac1be5-0231-46e3-8ab3-a013a0f403bc tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:58.061193 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-15ac1be5-0231-46e3-8ab3-a013a0f403bc tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:58.062369 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-15ac1be5-0231-46e3-8ab3-a013a0f403bc tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:58.063005 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-15ac1be5-0231-46e3-8ab3-a013a0f403bc tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:58.149796 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-fb3492f2-724d-4fea-b891-870b5318e037 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:58.162703 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-fb3492f2-724d-4fea-b891-870b5318e037 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1316 microversion: 2.1 time: 0.351416 Jan 19 16:02:58.163453 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 31/64] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:57 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1316 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:58.232349 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-15ac1be5-0231-46e3-8ab3-a013a0f403bc tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:58.242758 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-15ac1be5-0231-46e3-8ab3-a013a0f403bc tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1314 microversion: 2.1 time: 0.201948 Jan 19 16:02:58.243424 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 34/65] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:58 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:58.305124 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-7e5afbe3-aed7-44bb-92f9-d45f93bb80f3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:58.305124 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-7e5afbe3-aed7-44bb-92f9-d45f93bb80f3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:58.312211 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7e5afbe3-aed7-44bb-92f9-d45f93bb80f3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:58.316309 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7e5afbe3-aed7-44bb-92f9-d45f93bb80f3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:58.317988 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7e5afbe3-aed7-44bb-92f9-d45f93bb80f3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:58.319157 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7e5afbe3-aed7-44bb-92f9-d45f93bb80f3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:58.426993 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-cdd2740a-0369-4d18-b472-2aeba0948a16 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:58.430176 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-cdd2740a-0369-4d18-b472-2aeba0948a16 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:58.455671 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cdd2740a-0369-4d18-b472-2aeba0948a16 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:58.460684 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cdd2740a-0369-4d18-b472-2aeba0948a16 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:58.462026 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cdd2740a-0369-4d18-b472-2aeba0948a16 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:58.464707 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cdd2740a-0369-4d18-b472-2aeba0948a16 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:58.752165 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-cdd2740a-0369-4d18-b472-2aeba0948a16 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:58.783982 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-cdd2740a-0369-4d18-b472-2aeba0948a16 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1322 microversion: 2.1 time: 0.362810 Jan 19 16:02:58.805202 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 35/66] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:58 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:58.827865 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-09f040d0-5816-4ca0-8c73-25f37f37ed2d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:58.827997 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-7e5afbe3-aed7-44bb-92f9-d45f93bb80f3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:58.828958 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-09f040d0-5816-4ca0-8c73-25f37f37ed2d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:58.837008 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-7e5afbe3-aed7-44bb-92f9-d45f93bb80f3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1363 microversion: 2.1 time: 0.539611 Jan 19 16:02:58.837691 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 32/67] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:58 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1363 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:58.853629 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-09f040d0-5816-4ca0-8c73-25f37f37ed2d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:58.854337 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-09f040d0-5816-4ca0-8c73-25f37f37ed2d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:58.855873 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-09f040d0-5816-4ca0-8c73-25f37f37ed2d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:58.856559 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-09f040d0-5816-4ca0-8c73-25f37f37ed2d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:58.945382 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-09f040d0-5816-4ca0-8c73-25f37f37ed2d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:58.989195 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-09f040d0-5816-4ca0-8c73-25f37f37ed2d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:58.994891 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-09f040d0-5816-4ca0-8c73-25f37f37ed2d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:59.000583 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-09f040d0-5816-4ca0-8c73-25f37f37ed2d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1275 microversion: 2.20 time: 0.191972 Jan 19 16:02:59.002580 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 36/68] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:02:58 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1275 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:02:59.185447 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-06464d93-cdc7-4877-aedb-8c3131074c06 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:59.186954 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-06464d93-cdc7-4877-aedb-8c3131074c06 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:59.215752 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-06464d93-cdc7-4877-aedb-8c3131074c06 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:59.218625 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-06464d93-cdc7-4877-aedb-8c3131074c06 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:59.224673 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-06464d93-cdc7-4877-aedb-8c3131074c06 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:59.225768 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-06464d93-cdc7-4877-aedb-8c3131074c06 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:59.271200 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-306ca022-eef1-46f0-99c2-940eab8d7b72 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:59.272088 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-306ca022-eef1-46f0-99c2-940eab8d7b72 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:59.286603 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-306ca022-eef1-46f0-99c2-940eab8d7b72 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:59.292187 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-306ca022-eef1-46f0-99c2-940eab8d7b72 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:59.294292 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-306ca022-eef1-46f0-99c2-940eab8d7b72 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:59.294773 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-306ca022-eef1-46f0-99c2-940eab8d7b72 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:59.506734 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-306ca022-eef1-46f0-99c2-940eab8d7b72 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:59.514798 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-306ca022-eef1-46f0-99c2-940eab8d7b72 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1314 microversion: 2.1 time: 0.249406 Jan 19 16:02:59.525203 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 37/69] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:59 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:59.641331 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-06464d93-cdc7-4877-aedb-8c3131074c06 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:02:59.654359 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-06464d93-cdc7-4877-aedb-8c3131074c06 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1316 microversion: 2.1 time: 0.475577 Jan 19 16:02:59.666277 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 33/70] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:59 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1316 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:02:59.823281 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-aa09f99b-3c72-45e7-880e-91278e665b89 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:59.824244 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-aa09f99b-3c72-45e7-880e-91278e665b89 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:59.832305 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-aa09f99b-3c72-45e7-880e-91278e665b89 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:59.832881 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-aa09f99b-3c72-45e7-880e-91278e665b89 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:59.837656 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-aa09f99b-3c72-45e7-880e-91278e665b89 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:59.839180 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-aa09f99b-3c72-45e7-880e-91278e665b89 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:59.859973 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-970dbdce-8c54-4ad0-a6cf-842c7bd6b104 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:02:59.861991 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-970dbdce-8c54-4ad0-a6cf-842c7bd6b104 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:02:59.874005 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-970dbdce-8c54-4ad0-a6cf-842c7bd6b104 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:59.875374 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-970dbdce-8c54-4ad0-a6cf-842c7bd6b104 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:02:59.877246 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-970dbdce-8c54-4ad0-a6cf-842c7bd6b104 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:02:59.878330 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-970dbdce-8c54-4ad0-a6cf-842c7bd6b104 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:00.106950 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-aa09f99b-3c72-45e7-880e-91278e665b89 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:00.125366 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-aa09f99b-3c72-45e7-880e-91278e665b89 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1322 microversion: 2.1 time: 0.315457 Jan 19 16:03:00.135062 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 38/71] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:59 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:00.137175 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-37bd4cb9-7935-4683-a8b9-5527a119e912 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:00.137810 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-37bd4cb9-7935-4683-a8b9-5527a119e912 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:00.149554 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-37bd4cb9-7935-4683-a8b9-5527a119e912 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:00.150095 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-37bd4cb9-7935-4683-a8b9-5527a119e912 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:00.150941 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-37bd4cb9-7935-4683-a8b9-5527a119e912 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:00.151506 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-37bd4cb9-7935-4683-a8b9-5527a119e912 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:00.280140 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-37bd4cb9-7935-4683-a8b9-5527a119e912 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:00.298582 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-37bd4cb9-7935-4683-a8b9-5527a119e912 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:00.302855 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-37bd4cb9-7935-4683-a8b9-5527a119e912 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:00.306664 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-37bd4cb9-7935-4683-a8b9-5527a119e912 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1339 microversion: 2.20 time: 0.177297 Jan 19 16:03:00.308585 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 39/72] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:03:00 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1339 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:03:00.347353 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-970dbdce-8c54-4ad0-a6cf-842c7bd6b104 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:00.361565 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-970dbdce-8c54-4ad0-a6cf-842c7bd6b104 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1363 microversion: 2.1 time: 0.507204 Jan 19 16:03:00.363874 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 34/73] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:02:59 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1363 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:00.542722 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f50f68cd-4335-4785-bd9a-6524220c0be4 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:00.543923 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f50f68cd-4335-4785-bd9a-6524220c0be4 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:00.557868 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f50f68cd-4335-4785-bd9a-6524220c0be4 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:00.558616 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f50f68cd-4335-4785-bd9a-6524220c0be4 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:00.560081 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f50f68cd-4335-4785-bd9a-6524220c0be4 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:00.560818 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f50f68cd-4335-4785-bd9a-6524220c0be4 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:00.682517 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-3b80f922-a6d5-4cae-815b-287a0ea4c7bc tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:00.693634 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-3b80f922-a6d5-4cae-815b-287a0ea4c7bc tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:00.700313 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3b80f922-a6d5-4cae-815b-287a0ea4c7bc tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:00.701050 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3b80f922-a6d5-4cae-815b-287a0ea4c7bc tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:00.702829 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3b80f922-a6d5-4cae-815b-287a0ea4c7bc tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:00.704255 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3b80f922-a6d5-4cae-815b-287a0ea4c7bc tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:00.952073 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f50f68cd-4335-4785-bd9a-6524220c0be4 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:00.967013 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f50f68cd-4335-4785-bd9a-6524220c0be4 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1314 microversion: 2.1 time: 0.436287 Jan 19 16:03:00.968174 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 40/74] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:00 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:00.987009 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-3b80f922-a6d5-4cae-815b-287a0ea4c7bc tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:00.997955 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-3b80f922-a6d5-4cae-815b-287a0ea4c7bc tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1316 microversion: 2.1 time: 0.326861 Jan 19 16:03:00.998672 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 35/75] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:00 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1316 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:01.193094 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c60836ec-845d-4d40-b296-d0c60fec1bf3 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:01.193094 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c60836ec-845d-4d40-b296-d0c60fec1bf3 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:01.193094 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c60836ec-845d-4d40-b296-d0c60fec1bf3 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:01.193094 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c60836ec-845d-4d40-b296-d0c60fec1bf3 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:01.193974 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c60836ec-845d-4d40-b296-d0c60fec1bf3 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:01.193974 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c60836ec-845d-4d40-b296-d0c60fec1bf3 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:01.332447 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-9afa10c2-993f-4f83-8a41-37a590fccefb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:01.333810 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-9afa10c2-993f-4f83-8a41-37a590fccefb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:01.345052 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9afa10c2-993f-4f83-8a41-37a590fccefb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:01.345785 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9afa10c2-993f-4f83-8a41-37a590fccefb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:01.347870 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9afa10c2-993f-4f83-8a41-37a590fccefb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:01.348638 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9afa10c2-993f-4f83-8a41-37a590fccefb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:01.407327 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c60836ec-845d-4d40-b296-d0c60fec1bf3 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:01.420672 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c60836ec-845d-4d40-b296-d0c60fec1bf3 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1322 microversion: 2.1 time: 0.264139 Jan 19 16:03:01.422013 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 41/76] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:01 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:01.432012 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-4c777f8b-b991-4d58-bf99-164b4fa041bd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:01.433135 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-4c777f8b-b991-4d58-bf99-164b4fa041bd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:01.444665 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4c777f8b-b991-4d58-bf99-164b4fa041bd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:01.445370 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4c777f8b-b991-4d58-bf99-164b4fa041bd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:01.447335 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4c777f8b-b991-4d58-bf99-164b4fa041bd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:01.447760 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4c777f8b-b991-4d58-bf99-164b4fa041bd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:01.449741 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-9afa10c2-993f-4f83-8a41-37a590fccefb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:01.462371 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-9afa10c2-993f-4f83-8a41-37a590fccefb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:01.463966 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-9afa10c2-993f-4f83-8a41-37a590fccefb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:01.465281 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-9afa10c2-993f-4f83-8a41-37a590fccefb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1337 microversion: 2.20 time: 0.141320 Jan 19 16:03:01.465871 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 36/77] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:03:01 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1337 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:03:01.682778 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-4c777f8b-b991-4d58-bf99-164b4fa041bd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:01.697574 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-4c777f8b-b991-4d58-bf99-164b4fa041bd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1363 microversion: 2.1 time: 0.273253 Jan 19 16:03:01.698860 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 42/78] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:01 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:01.986418 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d85f9513-d1f1-40f5-943d-544e7772d1d3 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:01.994084 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d85f9513-d1f1-40f5-943d-544e7772d1d3 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:02.002119 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d85f9513-d1f1-40f5-943d-544e7772d1d3 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:02.004015 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d85f9513-d1f1-40f5-943d-544e7772d1d3 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:02.006066 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d85f9513-d1f1-40f5-943d-544e7772d1d3 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:02.017609 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-9f5c032d-017d-4989-8c28-c8a2d67a3695 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:02.018468 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-9f5c032d-017d-4989-8c28-c8a2d67a3695 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:02.022328 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d85f9513-d1f1-40f5-943d-544e7772d1d3 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:02.038623 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9f5c032d-017d-4989-8c28-c8a2d67a3695 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:02.039099 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9f5c032d-017d-4989-8c28-c8a2d67a3695 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:02.041732 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9f5c032d-017d-4989-8c28-c8a2d67a3695 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:02.046124 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9f5c032d-017d-4989-8c28-c8a2d67a3695 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:02.312739 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-9f5c032d-017d-4989-8c28-c8a2d67a3695 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:02.324847 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-9f5c032d-017d-4989-8c28-c8a2d67a3695 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1316 microversion: 2.1 time: 0.310973 Jan 19 16:03:02.326323 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 43/79] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:02 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1316 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:02.400632 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d85f9513-d1f1-40f5-943d-544e7772d1d3 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:02.409095 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d85f9513-d1f1-40f5-943d-544e7772d1d3 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1314 microversion: 2.1 time: 0.427118 Jan 19 16:03:02.419542 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 37/80] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:01 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:02.442615 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-9d405704-a302-4ff9-b550-7576b421c5f8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:02.443683 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-9d405704-a302-4ff9-b550-7576b421c5f8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:02.451268 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9d405704-a302-4ff9-b550-7576b421c5f8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:02.452147 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9d405704-a302-4ff9-b550-7576b421c5f8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:02.453775 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9d405704-a302-4ff9-b550-7576b421c5f8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:02.454477 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9d405704-a302-4ff9-b550-7576b421c5f8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:02.492232 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-fa278b3d-1ae5-496b-b371-ea23dfdd1a44 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:02.493445 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-fa278b3d-1ae5-496b-b371-ea23dfdd1a44 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:02.510570 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fa278b3d-1ae5-496b-b371-ea23dfdd1a44 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:02.511613 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fa278b3d-1ae5-496b-b371-ea23dfdd1a44 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:02.517672 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fa278b3d-1ae5-496b-b371-ea23dfdd1a44 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:02.517672 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fa278b3d-1ae5-496b-b371-ea23dfdd1a44 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:02.804918 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-9d405704-a302-4ff9-b550-7576b421c5f8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:02.808631 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-9d405704-a302-4ff9-b550-7576b421c5f8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1322 microversion: 2.1 time: 0.371797 Jan 19 16:03:02.813410 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 44/81] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:02 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1322 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:02.818619 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a5097159-5c28-4718-bead-306505fcea58 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:02.819708 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a5097159-5c28-4718-bead-306505fcea58 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:02.831552 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a5097159-5c28-4718-bead-306505fcea58 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:02.832324 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a5097159-5c28-4718-bead-306505fcea58 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:02.833392 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a5097159-5c28-4718-bead-306505fcea58 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:02.834887 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a5097159-5c28-4718-bead-306505fcea58 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:02.900039 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-fa278b3d-1ae5-496b-b371-ea23dfdd1a44 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:02.915251 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-fa278b3d-1ae5-496b-b371-ea23dfdd1a44 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:02.919106 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-fa278b3d-1ae5-496b-b371-ea23dfdd1a44 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:02.921717 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-fa278b3d-1ae5-496b-b371-ea23dfdd1a44 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1404 microversion: 2.20 time: 0.434258 Jan 19 16:03:02.923181 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 38/82] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:03:02 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1404 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:03:03.067226 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a5097159-5c28-4718-bead-306505fcea58 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:03.083695 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a5097159-5c28-4718-bead-306505fcea58 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1363 microversion: 2.1 time: 0.268082 Jan 19 16:03:03.084753 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 45/83] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:02 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:03.345252 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-3801dc71-ecc0-40e7-8472-ad8751526127 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:03.346314 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-3801dc71-ecc0-40e7-8472-ad8751526127 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:03.355702 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3801dc71-ecc0-40e7-8472-ad8751526127 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:03.356500 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3801dc71-ecc0-40e7-8472-ad8751526127 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:03.357756 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3801dc71-ecc0-40e7-8472-ad8751526127 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:03.358330 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3801dc71-ecc0-40e7-8472-ad8751526127 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:03.433092 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-116f0c41-0ce4-476c-a4ea-fdde426f0d58 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:03.434613 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-116f0c41-0ce4-476c-a4ea-fdde426f0d58 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:03.448974 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-116f0c41-0ce4-476c-a4ea-fdde426f0d58 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:03.451158 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-116f0c41-0ce4-476c-a4ea-fdde426f0d58 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:03.453263 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-116f0c41-0ce4-476c-a4ea-fdde426f0d58 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:03.454468 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-116f0c41-0ce4-476c-a4ea-fdde426f0d58 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:03.611610 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-3801dc71-ecc0-40e7-8472-ad8751526127 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:03.622345 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-3801dc71-ecc0-40e7-8472-ad8751526127 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1316 microversion: 2.1 time: 0.281310 Jan 19 16:03:03.632273 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 39/84] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:03 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1316 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:03.742287 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-116f0c41-0ce4-476c-a4ea-fdde426f0d58 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:03.755348 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-116f0c41-0ce4-476c-a4ea-fdde426f0d58 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1314 microversion: 2.1 time: 0.330166 Jan 19 16:03:03.757295 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 46/85] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:03 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:03.831421 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-af675c78-02a9-4910-b25d-c3d8e4399a11 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:03.832376 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-af675c78-02a9-4910-b25d-c3d8e4399a11 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:03.840253 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-af675c78-02a9-4910-b25d-c3d8e4399a11 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:03.840702 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-af675c78-02a9-4910-b25d-c3d8e4399a11 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:03.841495 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-af675c78-02a9-4910-b25d-c3d8e4399a11 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:03.841928 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-af675c78-02a9-4910-b25d-c3d8e4399a11 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:03.944374 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a845418b-9bf0-49f2-af18-60b86baf6afa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:03.945257 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a845418b-9bf0-49f2-af18-60b86baf6afa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:03.952169 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a845418b-9bf0-49f2-af18-60b86baf6afa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:03.952641 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a845418b-9bf0-49f2-af18-60b86baf6afa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:03.953488 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a845418b-9bf0-49f2-af18-60b86baf6afa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:03.958845 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a845418b-9bf0-49f2-af18-60b86baf6afa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:04.017866 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-af675c78-02a9-4910-b25d-c3d8e4399a11 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:04.035645 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-af675c78-02a9-4910-b25d-c3d8e4399a11 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1322 microversion: 2.1 time: 0.208291 Jan 19 16:03:04.037137 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 40/86] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:03 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:04.115395 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-8195527a-8557-40ad-b2f8-813d1efc850d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:04.123235 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8195527a-8557-40ad-b2f8-813d1efc850d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:04.152154 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8195527a-8557-40ad-b2f8-813d1efc850d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:04.153112 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8195527a-8557-40ad-b2f8-813d1efc850d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:04.158087 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8195527a-8557-40ad-b2f8-813d1efc850d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:04.162259 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8195527a-8557-40ad-b2f8-813d1efc850d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:04.281625 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a845418b-9bf0-49f2-af18-60b86baf6afa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:04.301636 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a845418b-9bf0-49f2-af18-60b86baf6afa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:04.305940 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a845418b-9bf0-49f2-af18-60b86baf6afa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:04.308408 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a845418b-9bf0-49f2-af18-60b86baf6afa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1404 microversion: 2.20 time: 0.367363 Jan 19 16:03:04.309875 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 47/87] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:03:03 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1404 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:03:04.631331 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8195527a-8557-40ad-b2f8-813d1efc850d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:04.642124 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-8195527a-8557-40ad-b2f8-813d1efc850d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1363 microversion: 2.1 time: 0.541118 Jan 19 16:03:04.642324 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b543d8c8-971a-4c2e-849a-63dfb5e42077 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:04.642865 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b543d8c8-971a-4c2e-849a-63dfb5e42077 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:04.644653 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 41/88] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:04 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1363 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:04.667095 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b543d8c8-971a-4c2e-849a-63dfb5e42077 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:04.668054 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b543d8c8-971a-4c2e-849a-63dfb5e42077 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:04.669802 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b543d8c8-971a-4c2e-849a-63dfb5e42077 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:04.670883 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b543d8c8-971a-4c2e-849a-63dfb5e42077 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:04.779487 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-22aa18c7-a9d0-4e87-94af-9627c65ed97d tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:04.780631 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-22aa18c7-a9d0-4e87-94af-9627c65ed97d tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:04.799155 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-22aa18c7-a9d0-4e87-94af-9627c65ed97d tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:04.800793 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-22aa18c7-a9d0-4e87-94af-9627c65ed97d tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:04.805497 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-22aa18c7-a9d0-4e87-94af-9627c65ed97d tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:04.807510 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-22aa18c7-a9d0-4e87-94af-9627c65ed97d tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:04.976064 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-b543d8c8-971a-4c2e-849a-63dfb5e42077 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:04.985316 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b543d8c8-971a-4c2e-849a-63dfb5e42077 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1316 microversion: 2.1 time: 0.348619 Jan 19 16:03:04.986195 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 48/89] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:04 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1316 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:05.066678 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-22aa18c7-a9d0-4e87-94af-9627c65ed97d tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:05.071498 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a59fd60e-cf05-4c8c-8dd8-6adcb781b446 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:05.073156 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a59fd60e-cf05-4c8c-8dd8-6adcb781b446 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:05.078422 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-22aa18c7-a9d0-4e87-94af-9627c65ed97d tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1314 microversion: 2.1 time: 0.304369 Jan 19 16:03:05.090816 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a59fd60e-cf05-4c8c-8dd8-6adcb781b446 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:05.091616 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a59fd60e-cf05-4c8c-8dd8-6adcb781b446 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:05.092030 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 42/90] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:04 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:05.093076 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a59fd60e-cf05-4c8c-8dd8-6adcb781b446 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:05.094875 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a59fd60e-cf05-4c8c-8dd8-6adcb781b446 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:05.340678 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-bfdaa5bf-7aad-4162-87f9-025fa45fefaa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:05.342844 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-bfdaa5bf-7aad-4162-87f9-025fa45fefaa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:05.354046 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bfdaa5bf-7aad-4162-87f9-025fa45fefaa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:05.355035 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bfdaa5bf-7aad-4162-87f9-025fa45fefaa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:05.356074 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bfdaa5bf-7aad-4162-87f9-025fa45fefaa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:05.356906 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bfdaa5bf-7aad-4162-87f9-025fa45fefaa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:05.429003 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a59fd60e-cf05-4c8c-8dd8-6adcb781b446 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:05.439378 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a59fd60e-cf05-4c8c-8dd8-6adcb781b446 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1322 microversion: 2.1 time: 0.379776 Jan 19 16:03:05.460707 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 49/91] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:05 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:05.551987 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-cd27223d-6b14-4b13-a869-792db14c8f4a req-39700b52-b305-4d31-84a2-9f16b290f356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02ba601a-94e7-486f-9d1b-7418ae534f4f", "tag": "51ed4245-58bf-4cc7-838e-9cad3734639e"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:05.553792 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:03:05.553792 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:03:05.562713 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-cd27223d-6b14-4b13-a869-792db14c8f4a req-39700b52-b305-4d31-84a2-9f16b290f356 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:05.563213 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-cd27223d-6b14-4b13-a869-792db14c8f4a req-39700b52-b305-4d31-84a2-9f16b290f356 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:05.583168 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-cd27223d-6b14-4b13-a869-792db14c8f4a req-39700b52-b305-4d31-84a2-9f16b290f356 service nova] Creating event network-changed:51ed4245-58bf-4cc7-838e-9cad3734639e for instance 02ba601a-94e7-486f-9d1b-7418ae534f4f on hv-cinder-82002 Jan 19 16:03:05.593064 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-cd27223d-6b14-4b13-a869-792db14c8f4a req-39700b52-b305-4d31-84a2-9f16b290f356 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045833 Jan 19 16:03:05.597946 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 50/92] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:03:05.665910 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b36ae276-ac5b-4788-a13c-7a921939c561 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:05.667054 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b36ae276-ac5b-4788-a13c-7a921939c561 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:05.680448 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b36ae276-ac5b-4788-a13c-7a921939c561 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:05.680448 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b36ae276-ac5b-4788-a13c-7a921939c561 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:05.680448 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b36ae276-ac5b-4788-a13c-7a921939c561 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:05.680448 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b36ae276-ac5b-4788-a13c-7a921939c561 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:05.735908 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-bfdaa5bf-7aad-4162-87f9-025fa45fefaa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:05.749534 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-bfdaa5bf-7aad-4162-87f9-025fa45fefaa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:05.753691 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-bfdaa5bf-7aad-4162-87f9-025fa45fefaa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:05.758130 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-bfdaa5bf-7aad-4162-87f9-025fa45fefaa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1404 microversion: 2.20 time: 0.423065 Jan 19 16:03:05.758130 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 43/93] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:03:05 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1404 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:03:05.919549 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-b36ae276-ac5b-4788-a13c-7a921939c561 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:05.929511 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b36ae276-ac5b-4788-a13c-7a921939c561 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1363 microversion: 2.1 time: 0.268837 Jan 19 16:03:05.930317 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 51/94] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:05 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:06.013981 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-53a07588-43c4-4e3c-aca2-facd16950c1e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:06.015151 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-53a07588-43c4-4e3c-aca2-facd16950c1e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:06.022065 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-53a07588-43c4-4e3c-aca2-facd16950c1e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:06.022898 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-53a07588-43c4-4e3c-aca2-facd16950c1e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:06.024143 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-53a07588-43c4-4e3c-aca2-facd16950c1e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:06.024895 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-53a07588-43c4-4e3c-aca2-facd16950c1e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:06.098429 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-2e4501a4-d31b-418d-9f0c-945a1dc07319 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:06.099887 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-2e4501a4-d31b-418d-9f0c-945a1dc07319 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:06.109821 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2e4501a4-d31b-418d-9f0c-945a1dc07319 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:06.121686 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2e4501a4-d31b-418d-9f0c-945a1dc07319 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:06.123419 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2e4501a4-d31b-418d-9f0c-945a1dc07319 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:06.124543 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2e4501a4-d31b-418d-9f0c-945a1dc07319 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:06.338109 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-53a07588-43c4-4e3c-aca2-facd16950c1e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:06.354312 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-53a07588-43c4-4e3c-aca2-facd16950c1e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1316 microversion: 2.1 time: 0.345690 Jan 19 16:03:06.359741 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 44/95] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:06 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1316 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:06.378716 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-2e4501a4-d31b-418d-9f0c-945a1dc07319 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:06.388586 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-2e4501a4-d31b-418d-9f0c-945a1dc07319 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1314 microversion: 2.1 time: 0.295604 Jan 19 16:03:06.389643 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 52/96] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:06 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:06.476611 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-67c5835a-295c-43ea-ac3e-58f7f24c97c0 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:06.477504 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-67c5835a-295c-43ea-ac3e-58f7f24c97c0 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:06.485386 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-67c5835a-295c-43ea-ac3e-58f7f24c97c0 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:06.485829 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-67c5835a-295c-43ea-ac3e-58f7f24c97c0 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:06.486748 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-67c5835a-295c-43ea-ac3e-58f7f24c97c0 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:06.487223 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-67c5835a-295c-43ea-ac3e-58f7f24c97c0 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:06.783894 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b301c04e-07de-4612-abee-dddb247469c4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:06.786609 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b301c04e-07de-4612-abee-dddb247469c4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:06.816203 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b301c04e-07de-4612-abee-dddb247469c4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:06.816784 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b301c04e-07de-4612-abee-dddb247469c4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:06.817939 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b301c04e-07de-4612-abee-dddb247469c4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:06.818599 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b301c04e-07de-4612-abee-dddb247469c4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:06.834778 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-67c5835a-295c-43ea-ac3e-58f7f24c97c0 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:06.856724 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-67c5835a-295c-43ea-ac3e-58f7f24c97c0 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1322 microversion: 2.1 time: 0.384880 Jan 19 16:03:06.869210 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 45/97] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:06 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1322 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:06.956972 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d653444e-144d-4142-b694-b04e8a83e265 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:06.957838 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d653444e-144d-4142-b694-b04e8a83e265 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:06.968489 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d653444e-144d-4142-b694-b04e8a83e265 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:06.969214 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d653444e-144d-4142-b694-b04e8a83e265 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:06.970541 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d653444e-144d-4142-b694-b04e8a83e265 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:06.971284 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d653444e-144d-4142-b694-b04e8a83e265 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:07.050719 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-b301c04e-07de-4612-abee-dddb247469c4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:07.063645 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-b301c04e-07de-4612-abee-dddb247469c4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:07.066892 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-b301c04e-07de-4612-abee-dddb247469c4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:07.068940 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b301c04e-07de-4612-abee-dddb247469c4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1404 microversion: 2.20 time: 0.291645 Jan 19 16:03:07.079691 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 53/98] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:03:06 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1404 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:03:07.131729 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d653444e-144d-4142-b694-b04e8a83e265 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:07.153056 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d653444e-144d-4142-b694-b04e8a83e265 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1363 microversion: 2.1 time: 0.207265 Jan 19 16:03:07.155189 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 46/99] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:06 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:07.382230 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-019b19da-a400-4d99-b68e-72c66f189516 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:07.382931 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-019b19da-a400-4d99-b68e-72c66f189516 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:07.389965 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-019b19da-a400-4d99-b68e-72c66f189516 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:07.390411 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-019b19da-a400-4d99-b68e-72c66f189516 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:07.391422 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-019b19da-a400-4d99-b68e-72c66f189516 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:07.391850 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-019b19da-a400-4d99-b68e-72c66f189516 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:07.409370 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-22965325-cc83-45be-b44c-62cecb7c3b79 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:07.410617 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-22965325-cc83-45be-b44c-62cecb7c3b79 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:07.419599 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-22965325-cc83-45be-b44c-62cecb7c3b79 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:07.420043 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-22965325-cc83-45be-b44c-62cecb7c3b79 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:07.420862 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-22965325-cc83-45be-b44c-62cecb7c3b79 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:07.421281 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-22965325-cc83-45be-b44c-62cecb7c3b79 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:07.641076 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-22965325-cc83-45be-b44c-62cecb7c3b79 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:07.643175 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-019b19da-a400-4d99-b68e-72c66f189516 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:07.653280 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-22965325-cc83-45be-b44c-62cecb7c3b79 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1314 microversion: 2.1 time: 0.248627 Jan 19 16:03:07.653978 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 47/100] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:07 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:07.661827 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-019b19da-a400-4d99-b68e-72c66f189516 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1316 microversion: 2.1 time: 0.283485 Jan 19 16:03:07.663412 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 54/101] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:07 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1316 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:07.875823 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c2395375-a37a-47e4-b1dc-5219526dc44f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:07.876396 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c2395375-a37a-47e4-b1dc-5219526dc44f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:07.883493 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c2395375-a37a-47e4-b1dc-5219526dc44f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:07.883940 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c2395375-a37a-47e4-b1dc-5219526dc44f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:07.884750 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c2395375-a37a-47e4-b1dc-5219526dc44f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:07.885187 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c2395375-a37a-47e4-b1dc-5219526dc44f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:08.069381 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c2395375-a37a-47e4-b1dc-5219526dc44f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:08.077423 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c2395375-a37a-47e4-b1dc-5219526dc44f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1322 microversion: 2.1 time: 0.205357 Jan 19 16:03:08.085589 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 48/102] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:07 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:08.089005 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-445db5fd-6834-4a72-a0ac-ef3f31200d5f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:08.089693 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-445db5fd-6834-4a72-a0ac-ef3f31200d5f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:08.096950 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-445db5fd-6834-4a72-a0ac-ef3f31200d5f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:08.097404 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-445db5fd-6834-4a72-a0ac-ef3f31200d5f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:08.101133 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-445db5fd-6834-4a72-a0ac-ef3f31200d5f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:08.101133 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-445db5fd-6834-4a72-a0ac-ef3f31200d5f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:08.178945 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ee981152-db39-48ff-9857-f40c3ca254aa tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:08.180119 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-ee981152-db39-48ff-9857-f40c3ca254aa tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:08.191270 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ee981152-db39-48ff-9857-f40c3ca254aa tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:08.192125 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ee981152-db39-48ff-9857-f40c3ca254aa tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:08.193592 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ee981152-db39-48ff-9857-f40c3ca254aa tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:08.194356 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ee981152-db39-48ff-9857-f40c3ca254aa tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:08.329247 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-445db5fd-6834-4a72-a0ac-ef3f31200d5f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:08.343023 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-445db5fd-6834-4a72-a0ac-ef3f31200d5f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:08.349248 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-445db5fd-6834-4a72-a0ac-ef3f31200d5f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:08.350710 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-445db5fd-6834-4a72-a0ac-ef3f31200d5f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1404 microversion: 2.20 time: 0.264882 Jan 19 16:03:08.351892 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 55/103] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:03:08 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1404 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:03:08.427331 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ee981152-db39-48ff-9857-f40c3ca254aa tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:08.437732 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-ee981152-db39-48ff-9857-f40c3ca254aa tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1363 microversion: 2.1 time: 0.266992 Jan 19 16:03:08.438574 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 49/104] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:08 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:08.684287 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-edf97f40-a4fe-4b74-9aed-a5136edd7a31 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:08.684585 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-cfa0b94c-46ce-40cf-90df-d47824874211 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:08.686107 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-cfa0b94c-46ce-40cf-90df-d47824874211 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:08.687176 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-edf97f40-a4fe-4b74-9aed-a5136edd7a31 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:08.694224 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cfa0b94c-46ce-40cf-90df-d47824874211 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:08.694659 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cfa0b94c-46ce-40cf-90df-d47824874211 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:08.696213 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cfa0b94c-46ce-40cf-90df-d47824874211 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:08.696836 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cfa0b94c-46ce-40cf-90df-d47824874211 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:08.701197 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-edf97f40-a4fe-4b74-9aed-a5136edd7a31 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:08.702174 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-edf97f40-a4fe-4b74-9aed-a5136edd7a31 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:08.708192 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-edf97f40-a4fe-4b74-9aed-a5136edd7a31 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:08.710014 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-edf97f40-a4fe-4b74-9aed-a5136edd7a31 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:08.931240 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-cfa0b94c-46ce-40cf-90df-d47824874211 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:08.942860 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-cfa0b94c-46ce-40cf-90df-d47824874211 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1316 microversion: 2.1 time: 0.264844 Jan 19 16:03:08.943381 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 50/105] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:08 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1316 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:08.978467 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-edf97f40-a4fe-4b74-9aed-a5136edd7a31 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:08.988604 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-edf97f40-a4fe-4b74-9aed-a5136edd7a31 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1314 microversion: 2.1 time: 0.312747 Jan 19 16:03:08.989797 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 56/106] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:08 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:09.106000 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-21838ff3-1c03-4029-98b1-7a72ee0847df tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:09.107123 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-21838ff3-1c03-4029-98b1-7a72ee0847df tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:09.118153 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-21838ff3-1c03-4029-98b1-7a72ee0847df tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:09.118942 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-21838ff3-1c03-4029-98b1-7a72ee0847df tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:09.120361 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-21838ff3-1c03-4029-98b1-7a72ee0847df tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:09.121135 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-21838ff3-1c03-4029-98b1-7a72ee0847df tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:09.366684 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-21838ff3-1c03-4029-98b1-7a72ee0847df tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:09.376736 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-21838ff3-1c03-4029-98b1-7a72ee0847df tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1322 microversion: 2.1 time: 0.277517 Jan 19 16:03:09.378517 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 51/107] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:09 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:09.382593 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8e667dfc-0d0e-4b12-919d-554f2adba15d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:09.383536 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-8e667dfc-0d0e-4b12-919d-554f2adba15d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:09.395844 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8e667dfc-0d0e-4b12-919d-554f2adba15d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:09.396496 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8e667dfc-0d0e-4b12-919d-554f2adba15d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:09.397539 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8e667dfc-0d0e-4b12-919d-554f2adba15d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:09.398419 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8e667dfc-0d0e-4b12-919d-554f2adba15d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:09.456371 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-fabb793b-cf44-4095-85a8-982c9c43af1c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:09.457101 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-fabb793b-cf44-4095-85a8-982c9c43af1c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:09.464696 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fabb793b-cf44-4095-85a8-982c9c43af1c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:09.465438 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fabb793b-cf44-4095-85a8-982c9c43af1c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:09.466392 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fabb793b-cf44-4095-85a8-982c9c43af1c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:09.466921 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fabb793b-cf44-4095-85a8-982c9c43af1c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:09.667126 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8e667dfc-0d0e-4b12-919d-554f2adba15d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:09.686232 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8e667dfc-0d0e-4b12-919d-554f2adba15d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:09.690114 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8e667dfc-0d0e-4b12-919d-554f2adba15d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:09.697732 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-8e667dfc-0d0e-4b12-919d-554f2adba15d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1404 microversion: 2.20 time: 0.322221 Jan 19 16:03:09.698805 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 57/108] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:03:09 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1404 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:03:09.701831 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-fabb793b-cf44-4095-85a8-982c9c43af1c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:09.712951 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-fabb793b-cf44-4095-85a8-982c9c43af1c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1363 microversion: 2.1 time: 0.261448 Jan 19 16:03:09.713909 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 52/109] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:09 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:09.967895 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b1af52da-a8cb-4aba-a678-9532bd666016 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:09.968806 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b1af52da-a8cb-4aba-a678-9532bd666016 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:09.976952 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b1af52da-a8cb-4aba-a678-9532bd666016 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:09.977572 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b1af52da-a8cb-4aba-a678-9532bd666016 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:09.978592 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b1af52da-a8cb-4aba-a678-9532bd666016 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:09.979138 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b1af52da-a8cb-4aba-a678-9532bd666016 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:10.016684 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f558d7c9-ae37-45db-a310-e9826e3eab5a tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:10.017933 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-f558d7c9-ae37-45db-a310-e9826e3eab5a tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:10.041073 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f558d7c9-ae37-45db-a310-e9826e3eab5a tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:10.042109 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f558d7c9-ae37-45db-a310-e9826e3eab5a tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:10.043688 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f558d7c9-ae37-45db-a310-e9826e3eab5a tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:10.044723 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f558d7c9-ae37-45db-a310-e9826e3eab5a tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:10.146737 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-b1af52da-a8cb-4aba-a678-9532bd666016 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:10.158119 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b1af52da-a8cb-4aba-a678-9532bd666016 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1316 microversion: 2.1 time: 0.196751 Jan 19 16:03:10.168089 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 58/110] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:09 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1316 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:10.233460 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-f558d7c9-ae37-45db-a310-e9826e3eab5a tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:10.241455 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f558d7c9-ae37-45db-a310-e9826e3eab5a tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1314 microversion: 2.1 time: 0.232578 Jan 19 16:03:10.242070 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 53/111] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:10 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:10.404540 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-aefb36ea-e816-4d6e-b179-9f9d2233fb95 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:10.406040 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-aefb36ea-e816-4d6e-b179-9f9d2233fb95 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:10.414702 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-aefb36ea-e816-4d6e-b179-9f9d2233fb95 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:10.415566 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-aefb36ea-e816-4d6e-b179-9f9d2233fb95 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:10.416767 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-aefb36ea-e816-4d6e-b179-9f9d2233fb95 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:10.417846 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-aefb36ea-e816-4d6e-b179-9f9d2233fb95 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:10.686559 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-aefb36ea-e816-4d6e-b179-9f9d2233fb95 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:10.696878 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-aefb36ea-e816-4d6e-b179-9f9d2233fb95 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1322 microversion: 2.1 time: 0.296757 Jan 19 16:03:10.706049 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 59/112] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:10 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:10.720208 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-4255c485-f7dc-4e49-931d-b814f844eca5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:10.721365 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-4255c485-f7dc-4e49-931d-b814f844eca5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:10.734387 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4255c485-f7dc-4e49-931d-b814f844eca5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:10.735830 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4255c485-f7dc-4e49-931d-b814f844eca5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:10.738628 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-1ad1c5e1-a53f-44f0-8084-2477cbd99e7e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:10.738927 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4255c485-f7dc-4e49-931d-b814f844eca5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:10.740015 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4255c485-f7dc-4e49-931d-b814f844eca5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:10.740870 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-1ad1c5e1-a53f-44f0-8084-2477cbd99e7e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:10.761506 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1ad1c5e1-a53f-44f0-8084-2477cbd99e7e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:10.776186 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1ad1c5e1-a53f-44f0-8084-2477cbd99e7e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:10.777854 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1ad1c5e1-a53f-44f0-8084-2477cbd99e7e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:10.778499 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1ad1c5e1-a53f-44f0-8084-2477cbd99e7e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:11.034460 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-1ad1c5e1-a53f-44f0-8084-2477cbd99e7e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:11.042540 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-1ad1c5e1-a53f-44f0-8084-2477cbd99e7e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1363 microversion: 2.1 time: 0.313663 Jan 19 16:03:11.052530 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 60/113] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:10 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1363 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:11.147406 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-4255c485-f7dc-4e49-931d-b814f844eca5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:11.157265 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-4255c485-f7dc-4e49-931d-b814f844eca5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:11.159876 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-4255c485-f7dc-4e49-931d-b814f844eca5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:11.161242 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-4255c485-f7dc-4e49-931d-b814f844eca5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1404 microversion: 2.20 time: 0.448417 Jan 19 16:03:11.162202 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 54/114] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:03:10 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1404 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:03:11.191074 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-dcfde447-72cf-4cba-8d6d-d20fdef05ec1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:11.191998 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-dcfde447-72cf-4cba-8d6d-d20fdef05ec1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:11.200601 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dcfde447-72cf-4cba-8d6d-d20fdef05ec1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:11.201306 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dcfde447-72cf-4cba-8d6d-d20fdef05ec1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:11.202366 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dcfde447-72cf-4cba-8d6d-d20fdef05ec1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:11.203158 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dcfde447-72cf-4cba-8d6d-d20fdef05ec1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:11.266789 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-5d870151-fd25-4fd2-8a62-2f9d2dd6266e tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:11.267648 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-5d870151-fd25-4fd2-8a62-2f9d2dd6266e tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:11.280531 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5d870151-fd25-4fd2-8a62-2f9d2dd6266e tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:11.281203 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5d870151-fd25-4fd2-8a62-2f9d2dd6266e tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:11.292033 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5d870151-fd25-4fd2-8a62-2f9d2dd6266e tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:11.293668 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5d870151-fd25-4fd2-8a62-2f9d2dd6266e tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:11.521170 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-5d870151-fd25-4fd2-8a62-2f9d2dd6266e tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:11.543772 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-5d870151-fd25-4fd2-8a62-2f9d2dd6266e tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1314 microversion: 2.1 time: 0.282619 Jan 19 16:03:11.553011 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-dcfde447-72cf-4cba-8d6d-d20fdef05ec1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:11.563834 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 55/115] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:11 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:11.568623 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-dcfde447-72cf-4cba-8d6d-d20fdef05ec1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1316 microversion: 2.1 time: 0.395782 Jan 19 16:03:11.569864 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 61/116] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:11 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1316 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:11.717765 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f6f28a11-cfcc-4173-ae5e-aa94482f5a1c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:11.718827 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-f6f28a11-cfcc-4173-ae5e-aa94482f5a1c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:11.748453 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f6f28a11-cfcc-4173-ae5e-aa94482f5a1c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:11.749266 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f6f28a11-cfcc-4173-ae5e-aa94482f5a1c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:11.750729 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f6f28a11-cfcc-4173-ae5e-aa94482f5a1c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:11.751554 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f6f28a11-cfcc-4173-ae5e-aa94482f5a1c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:11.949462 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-f6f28a11-cfcc-4173-ae5e-aa94482f5a1c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:11.961394 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f6f28a11-cfcc-4173-ae5e-aa94482f5a1c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1322 microversion: 2.1 time: 0.250236 Jan 19 16:03:11.962896 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 56/117] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:11 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:12.059759 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b9ef76b6-c52f-4677-b3e5-e69ff5b2ec5d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:12.060376 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b9ef76b6-c52f-4677-b3e5-e69ff5b2ec5d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:12.066964 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b9ef76b6-c52f-4677-b3e5-e69ff5b2ec5d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:12.067437 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b9ef76b6-c52f-4677-b3e5-e69ff5b2ec5d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:12.068274 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b9ef76b6-c52f-4677-b3e5-e69ff5b2ec5d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:12.068700 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b9ef76b6-c52f-4677-b3e5-e69ff5b2ec5d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:12.202263 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-38088026-dd8f-401c-935b-bd6a51518756 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:12.205145 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-38088026-dd8f-401c-935b-bd6a51518756 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:12.213482 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-38088026-dd8f-401c-935b-bd6a51518756 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:12.214104 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-38088026-dd8f-401c-935b-bd6a51518756 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:12.215641 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-38088026-dd8f-401c-935b-bd6a51518756 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:12.216761 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-38088026-dd8f-401c-935b-bd6a51518756 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:12.247387 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-b9ef76b6-c52f-4677-b3e5-e69ff5b2ec5d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:12.265882 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b9ef76b6-c52f-4677-b3e5-e69ff5b2ec5d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1363 microversion: 2.1 time: 0.210064 Jan 19 16:03:12.268687 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 62/118] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:12 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:12.390431 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-38088026-dd8f-401c-935b-bd6a51518756 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:12.398437 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-38088026-dd8f-401c-935b-bd6a51518756 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:12.399956 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-38088026-dd8f-401c-935b-bd6a51518756 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:12.401074 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-38088026-dd8f-401c-935b-bd6a51518756 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1404 microversion: 2.20 time: 0.206110 Jan 19 16:03:12.401866 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 57/119] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:03:12 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1404 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:03:12.571397 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-7f11c4b7-68fb-4353-b94b-1e1d5d7e0208 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:12.572247 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-7f11c4b7-68fb-4353-b94b-1e1d5d7e0208 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:12.578856 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7f11c4b7-68fb-4353-b94b-1e1d5d7e0208 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:12.579336 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7f11c4b7-68fb-4353-b94b-1e1d5d7e0208 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:12.580193 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7f11c4b7-68fb-4353-b94b-1e1d5d7e0208 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:12.580653 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7f11c4b7-68fb-4353-b94b-1e1d5d7e0208 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:12.592544 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f22a02d1-5a0b-4340-bbc8-f4a2a791da7b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:12.594156 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-f22a02d1-5a0b-4340-bbc8-f4a2a791da7b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:12.610233 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f22a02d1-5a0b-4340-bbc8-f4a2a791da7b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:12.611117 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f22a02d1-5a0b-4340-bbc8-f4a2a791da7b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:12.613349 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f22a02d1-5a0b-4340-bbc8-f4a2a791da7b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:12.614271 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f22a02d1-5a0b-4340-bbc8-f4a2a791da7b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:12.748081 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-7f11c4b7-68fb-4353-b94b-1e1d5d7e0208 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:12.755512 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-7f11c4b7-68fb-4353-b94b-1e1d5d7e0208 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1314 microversion: 2.1 time: 0.187715 Jan 19 16:03:12.758203 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 63/120] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:12 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:12.785754 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-f22a02d1-5a0b-4340-bbc8-f4a2a791da7b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:12.793775 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f22a02d1-5a0b-4340-bbc8-f4a2a791da7b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1316 microversion: 2.1 time: 0.208803 Jan 19 16:03:12.794651 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 58/121] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:12 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1316 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:12.980735 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-2bfd8b3a-4f16-4559-87fa-b4b0f2d85218 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:12.981507 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-2bfd8b3a-4f16-4559-87fa-b4b0f2d85218 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:12.988387 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2bfd8b3a-4f16-4559-87fa-b4b0f2d85218 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:12.988851 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2bfd8b3a-4f16-4559-87fa-b4b0f2d85218 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:12.989687 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2bfd8b3a-4f16-4559-87fa-b4b0f2d85218 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:12.990137 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2bfd8b3a-4f16-4559-87fa-b4b0f2d85218 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:13.148019 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-2bfd8b3a-4f16-4559-87fa-b4b0f2d85218 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:13.158325 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-2bfd8b3a-4f16-4559-87fa-b4b0f2d85218 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1322 microversion: 2.1 time: 0.179556 Jan 19 16:03:13.158325 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 64/122] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:12 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:13.291735 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e8dcc87a-8e5f-49db-9b49-cc35bd82aec4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:13.294103 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-e8dcc87a-8e5f-49db-9b49-cc35bd82aec4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:13.300377 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e8dcc87a-8e5f-49db-9b49-cc35bd82aec4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:13.300815 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e8dcc87a-8e5f-49db-9b49-cc35bd82aec4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:13.301805 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e8dcc87a-8e5f-49db-9b49-cc35bd82aec4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:13.302291 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e8dcc87a-8e5f-49db-9b49-cc35bd82aec4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:13.420618 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c71bda56-c040-429f-b530-6079fe7a9e8b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:13.420857 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c71bda56-c040-429f-b530-6079fe7a9e8b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:13.427857 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c71bda56-c040-429f-b530-6079fe7a9e8b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:13.428559 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c71bda56-c040-429f-b530-6079fe7a9e8b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:13.429358 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c71bda56-c040-429f-b530-6079fe7a9e8b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:13.429797 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c71bda56-c040-429f-b530-6079fe7a9e8b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:13.494279 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e8dcc87a-8e5f-49db-9b49-cc35bd82aec4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:13.510424 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e8dcc87a-8e5f-49db-9b49-cc35bd82aec4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1363 microversion: 2.1 time: 0.222414 Jan 19 16:03:13.511772 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 59/123] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:13 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:13.609729 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c71bda56-c040-429f-b530-6079fe7a9e8b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:13.625007 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c71bda56-c040-429f-b530-6079fe7a9e8b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:13.628708 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c71bda56-c040-429f-b530-6079fe7a9e8b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:13.630856 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c71bda56-c040-429f-b530-6079fe7a9e8b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1404 microversion: 2.20 time: 0.215371 Jan 19 16:03:13.631915 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 65/124] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:03:13 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1404 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:03:13.772145 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-3c030376-512b-44f1-8999-0943bcf2b159 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:13.772675 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-3c030376-512b-44f1-8999-0943bcf2b159 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:13.781774 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3c030376-512b-44f1-8999-0943bcf2b159 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:13.782209 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3c030376-512b-44f1-8999-0943bcf2b159 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:13.783022 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3c030376-512b-44f1-8999-0943bcf2b159 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:13.783470 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3c030376-512b-44f1-8999-0943bcf2b159 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:13.812414 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f74876f4-6763-4857-87ea-7e30418b44e6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:13.813099 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f74876f4-6763-4857-87ea-7e30418b44e6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:13.820652 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f74876f4-6763-4857-87ea-7e30418b44e6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:13.821096 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f74876f4-6763-4857-87ea-7e30418b44e6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:13.821891 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f74876f4-6763-4857-87ea-7e30418b44e6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:13.822323 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f74876f4-6763-4857-87ea-7e30418b44e6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:13.968888 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-3c030376-512b-44f1-8999-0943bcf2b159 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:13.974408 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f74876f4-6763-4857-87ea-7e30418b44e6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:13.979633 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-3c030376-512b-44f1-8999-0943bcf2b159 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1314 microversion: 2.1 time: 0.211259 Jan 19 16:03:13.980627 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 60/125] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:13 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:13.982035 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f74876f4-6763-4857-87ea-7e30418b44e6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1316 microversion: 2.1 time: 0.173568 Jan 19 16:03:13.982615 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 66/126] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:13 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:14.185387 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-827aa789-7d43-4709-b27b-04838d545998 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:14.186005 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-827aa789-7d43-4709-b27b-04838d545998 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:14.192114 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-827aa789-7d43-4709-b27b-04838d545998 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:14.192560 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-827aa789-7d43-4709-b27b-04838d545998 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:14.193556 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-827aa789-7d43-4709-b27b-04838d545998 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:14.193980 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-827aa789-7d43-4709-b27b-04838d545998 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:14.342317 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-827aa789-7d43-4709-b27b-04838d545998 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:14.353480 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-827aa789-7d43-4709-b27b-04838d545998 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1322 microversion: 2.1 time: 0.173248 Jan 19 16:03:14.354236 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 61/127] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:14 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:14.531662 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-96c4afa8-34b0-4ee7-9ea8-440594044603 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:14.532526 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-96c4afa8-34b0-4ee7-9ea8-440594044603 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:14.542553 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-96c4afa8-34b0-4ee7-9ea8-440594044603 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:14.543256 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-96c4afa8-34b0-4ee7-9ea8-440594044603 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:14.544252 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-96c4afa8-34b0-4ee7-9ea8-440594044603 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:14.544960 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-96c4afa8-34b0-4ee7-9ea8-440594044603 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:14.654181 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-25a57f02-b3fc-4066-ba29-d96ef82fd37d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:14.655527 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-25a57f02-b3fc-4066-ba29-d96ef82fd37d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:14.670901 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-25a57f02-b3fc-4066-ba29-d96ef82fd37d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:14.681157 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-25a57f02-b3fc-4066-ba29-d96ef82fd37d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:14.681157 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-25a57f02-b3fc-4066-ba29-d96ef82fd37d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:14.681157 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-25a57f02-b3fc-4066-ba29-d96ef82fd37d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:14.745084 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-96c4afa8-34b0-4ee7-9ea8-440594044603 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:14.760392 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-96c4afa8-34b0-4ee7-9ea8-440594044603 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1363 microversion: 2.1 time: 0.234531 Jan 19 16:03:14.761145 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 67/128] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:14 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:14.857828 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-25a57f02-b3fc-4066-ba29-d96ef82fd37d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:14.872544 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-25a57f02-b3fc-4066-ba29-d96ef82fd37d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:14.875798 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-25a57f02-b3fc-4066-ba29-d96ef82fd37d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:14.878560 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-25a57f02-b3fc-4066-ba29-d96ef82fd37d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1404 microversion: 2.20 time: 0.230353 Jan 19 16:03:14.879455 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 62/129] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:03:14 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1404 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:03:14.999466 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e24c55f6-1876-4e80-bb8d-84f632a8f29e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:15.000067 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-e24c55f6-1876-4e80-bb8d-84f632a8f29e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:15.004542 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d004f9a0-a9bd-477f-bf98-ccf90eba2259 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:15.005150 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d004f9a0-a9bd-477f-bf98-ccf90eba2259 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:15.007175 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e24c55f6-1876-4e80-bb8d-84f632a8f29e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:15.007564 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e24c55f6-1876-4e80-bb8d-84f632a8f29e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:15.008360 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e24c55f6-1876-4e80-bb8d-84f632a8f29e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:15.008792 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e24c55f6-1876-4e80-bb8d-84f632a8f29e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:15.011858 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d004f9a0-a9bd-477f-bf98-ccf90eba2259 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:15.012305 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d004f9a0-a9bd-477f-bf98-ccf90eba2259 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:15.013128 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d004f9a0-a9bd-477f-bf98-ccf90eba2259 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:15.013538 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d004f9a0-a9bd-477f-bf98-ccf90eba2259 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:15.208135 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e24c55f6-1876-4e80-bb8d-84f632a8f29e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:15.228075 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e24c55f6-1876-4e80-bb8d-84f632a8f29e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1316 microversion: 2.1 time: 0.222482 Jan 19 16:03:15.228197 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d004f9a0-a9bd-477f-bf98-ccf90eba2259 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:15.228998 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 68/130] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:14 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1316 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:15.234273 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d004f9a0-a9bd-477f-bf98-ccf90eba2259 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1314 microversion: 2.1 time: 0.233588 Jan 19 16:03:15.235077 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 63/131] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:14 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:15.378536 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-10e0a996-b87d-4acc-92a7-6a8c3b678754 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:15.379784 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-10e0a996-b87d-4acc-92a7-6a8c3b678754 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:15.386246 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-10e0a996-b87d-4acc-92a7-6a8c3b678754 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:15.386893 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-10e0a996-b87d-4acc-92a7-6a8c3b678754 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:15.388945 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-10e0a996-b87d-4acc-92a7-6a8c3b678754 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:15.388945 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-10e0a996-b87d-4acc-92a7-6a8c3b678754 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:15.558620 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-10e0a996-b87d-4acc-92a7-6a8c3b678754 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:15.571175 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-10e0a996-b87d-4acc-92a7-6a8c3b678754 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1322 microversion: 2.1 time: 0.196971 Jan 19 16:03:15.582016 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 69/132] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:15 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:15.781847 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ee62efd4-d6ce-4266-ad26-8878842cee95 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:15.782520 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ee62efd4-d6ce-4266-ad26-8878842cee95 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:15.791459 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ee62efd4-d6ce-4266-ad26-8878842cee95 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:15.792217 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ee62efd4-d6ce-4266-ad26-8878842cee95 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:15.793929 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ee62efd4-d6ce-4266-ad26-8878842cee95 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:15.794575 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ee62efd4-d6ce-4266-ad26-8878842cee95 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:15.809097 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-07fb9fb0-1b44-40a8-bc55-64a1d244d148 req-d0f9e8e5-bc7a-4508-81bb-732cdf2236c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "808abc0b-bb27-496f-8ce0-d536ab3d1ffb", "name": "network-vif-plugged", "status": "completed", "tag": "25aa7996-bdd0-49c3-bda2-801229048370"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:15.811791 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:03:15.811791 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:03:15.824380 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-07fb9fb0-1b44-40a8-bc55-64a1d244d148 req-d0f9e8e5-bc7a-4508-81bb-732cdf2236c4 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:15.825397 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-07fb9fb0-1b44-40a8-bc55-64a1d244d148 req-d0f9e8e5-bc7a-4508-81bb-732cdf2236c4 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:15.851476 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-07fb9fb0-1b44-40a8-bc55-64a1d244d148 req-d0f9e8e5-bc7a-4508-81bb-732cdf2236c4 service nova] Creating event network-vif-plugged:25aa7996-bdd0-49c3-bda2-801229048370 for instance 808abc0b-bb27-496f-8ce0-d536ab3d1ffb on hv-cinder-82002 Jan 19 16:03:15.856908 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-07fb9fb0-1b44-40a8-bc55-64a1d244d148 req-d0f9e8e5-bc7a-4508-81bb-732cdf2236c4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111380 Jan 19 16:03:15.857547 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 64/133] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:03:15.913788 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-bc8cdff7-6742-414d-aebb-858651efafb6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:15.915295 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-bc8cdff7-6742-414d-aebb-858651efafb6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:15.924364 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bc8cdff7-6742-414d-aebb-858651efafb6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:15.925312 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bc8cdff7-6742-414d-aebb-858651efafb6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:15.926188 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bc8cdff7-6742-414d-aebb-858651efafb6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:15.926688 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bc8cdff7-6742-414d-aebb-858651efafb6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:15.987741 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ee62efd4-d6ce-4266-ad26-8878842cee95 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:15.998536 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ee62efd4-d6ce-4266-ad26-8878842cee95 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1363 microversion: 2.1 time: 0.220263 Jan 19 16:03:16.000014 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 70/134] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:15 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:16.141413 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-bc8cdff7-6742-414d-aebb-858651efafb6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:16.152576 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-bc8cdff7-6742-414d-aebb-858651efafb6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:16.154941 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-bc8cdff7-6742-414d-aebb-858651efafb6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:16.156385 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-bc8cdff7-6742-414d-aebb-858651efafb6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1404 microversion: 2.20 time: 0.251544 Jan 19 16:03:16.157781 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 65/135] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:03:15 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1404 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:03:16.235216 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-13984667-904f-47cf-b90a-955677258a63 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:16.236041 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-13984667-904f-47cf-b90a-955677258a63 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:16.242558 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-13984667-904f-47cf-b90a-955677258a63 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:16.243180 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-13984667-904f-47cf-b90a-955677258a63 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:16.244196 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-13984667-904f-47cf-b90a-955677258a63 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:16.244940 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-13984667-904f-47cf-b90a-955677258a63 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:16.253415 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-a0b75e72-855e-4a55-9a7e-87d19a945d3c tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:16.260515 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-a0b75e72-855e-4a55-9a7e-87d19a945d3c tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:16.264800 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a0b75e72-855e-4a55-9a7e-87d19a945d3c tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:16.269461 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a0b75e72-855e-4a55-9a7e-87d19a945d3c tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:16.270679 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a0b75e72-855e-4a55-9a7e-87d19a945d3c tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:16.271360 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a0b75e72-855e-4a55-9a7e-87d19a945d3c tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:16.562846 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-13984667-904f-47cf-b90a-955677258a63 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:16.573257 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-13984667-904f-47cf-b90a-955677258a63 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1316 microversion: 2.1 time: 0.341847 Jan 19 16:03:16.574388 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 71/136] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:16 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1316 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:16.585802 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-a0b75e72-855e-4a55-9a7e-87d19a945d3c tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:16.595551 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c8857275-c98c-46e9-857c-50dabbef3dd2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:16.596857 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c8857275-c98c-46e9-857c-50dabbef3dd2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:16.597052 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-a0b75e72-855e-4a55-9a7e-87d19a945d3c tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1314 microversion: 2.1 time: 0.348136 Jan 19 16:03:16.603716 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 66/137] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:16 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:16.610582 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c8857275-c98c-46e9-857c-50dabbef3dd2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:16.611470 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c8857275-c98c-46e9-857c-50dabbef3dd2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:16.614213 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c8857275-c98c-46e9-857c-50dabbef3dd2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:16.615653 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c8857275-c98c-46e9-857c-50dabbef3dd2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:16.903514 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c8857275-c98c-46e9-857c-50dabbef3dd2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:16.914836 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c8857275-c98c-46e9-857c-50dabbef3dd2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1322 microversion: 2.1 time: 0.323121 Jan 19 16:03:16.914836 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 72/138] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:16 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:17.015679 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-85836052-dfc3-4547-a3fe-9a6ef2ac5634 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:17.016460 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-85836052-dfc3-4547-a3fe-9a6ef2ac5634 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:17.022783 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-85836052-dfc3-4547-a3fe-9a6ef2ac5634 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:17.023260 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-85836052-dfc3-4547-a3fe-9a6ef2ac5634 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:17.024121 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-85836052-dfc3-4547-a3fe-9a6ef2ac5634 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:17.024545 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-85836052-dfc3-4547-a3fe-9a6ef2ac5634 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:17.175931 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e6e17160-37c2-45f6-b7a8-e00938626099 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:17.176531 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-e6e17160-37c2-45f6-b7a8-e00938626099 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:17.182996 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e6e17160-37c2-45f6-b7a8-e00938626099 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:17.183448 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e6e17160-37c2-45f6-b7a8-e00938626099 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:17.184229 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e6e17160-37c2-45f6-b7a8-e00938626099 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:17.184835 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e6e17160-37c2-45f6-b7a8-e00938626099 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:17.219661 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-85836052-dfc3-4547-a3fe-9a6ef2ac5634 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:17.228395 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-85836052-dfc3-4547-a3fe-9a6ef2ac5634 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1363 microversion: 2.1 time: 0.216347 Jan 19 16:03:17.239222 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 67/139] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:17 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:17.348609 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e6e17160-37c2-45f6-b7a8-e00938626099 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:17.357123 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e6e17160-37c2-45f6-b7a8-e00938626099 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:17.358627 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e6e17160-37c2-45f6-b7a8-e00938626099 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:17.359786 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e6e17160-37c2-45f6-b7a8-e00938626099 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1404 microversion: 2.20 time: 0.188568 Jan 19 16:03:17.360351 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 73/140] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:03:17 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1404 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:03:17.600457 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-fe56df8a-81c5-45ee-a61b-255666fa3bd8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:17.601205 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-fe56df8a-81c5-45ee-a61b-255666fa3bd8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:17.608146 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fe56df8a-81c5-45ee-a61b-255666fa3bd8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:17.608883 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fe56df8a-81c5-45ee-a61b-255666fa3bd8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:17.609883 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fe56df8a-81c5-45ee-a61b-255666fa3bd8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:17.610519 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fe56df8a-81c5-45ee-a61b-255666fa3bd8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:17.630265 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3513f6e0-f204-4a86-a7b0-29be3e8b93ee tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:17.634960 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3513f6e0-f204-4a86-a7b0-29be3e8b93ee tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:17.641724 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3513f6e0-f204-4a86-a7b0-29be3e8b93ee tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:17.642171 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3513f6e0-f204-4a86-a7b0-29be3e8b93ee tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:17.643660 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3513f6e0-f204-4a86-a7b0-29be3e8b93ee tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:17.644289 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3513f6e0-f204-4a86-a7b0-29be3e8b93ee tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:17.833171 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-fe56df8a-81c5-45ee-a61b-255666fa3bd8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:17.853400 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-fe56df8a-81c5-45ee-a61b-255666fa3bd8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1316 microversion: 2.1 time: 0.256519 Jan 19 16:03:17.854366 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 68/141] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:17 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:17.880674 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-8de56c7e-57fe-48b6-8d4d-bcf9d3c59eed req-df7b61ae-a8f9-48bb-88b7-2f31ec5c92ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eafd976-e41c-44be-8b8e-358dd69f371d", "name": "network-vif-plugged", "status": "completed", "tag": "249b2651-5483-475a-b81d-a745b21a7e43"}, {"server_uuid": "a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a", "name": "network-vif-plugged", "status": "completed", "tag": "c7242af9-f303-413b-adb2-3e898621610a"}, {"server_uuid": "d843b329-8449-4eb9-9d5b-a12764773e75", "name": "network-vif-plugged", "status": "completed", "tag": "0c10b593-ffa7-45ab-aae4-22eb81766637"}, {"server_uuid": "cf8c20cd-e1b6-415c-9811-c58dbcf31b49", "name": "network-vif-plugged", "status": "completed", "tag": "eccf3abd-c626-40ae-a8b0-a9dcdf81545f"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:17.884813 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:03:17.884813 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:03:17.887310 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-3513f6e0-f204-4a86-a7b0-29be3e8b93ee tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:17.897702 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3513f6e0-f204-4a86-a7b0-29be3e8b93ee tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1314 microversion: 2.1 time: 0.285751 Jan 19 16:03:17.898624 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 74/142] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:17 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:17.901197 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-8de56c7e-57fe-48b6-8d4d-bcf9d3c59eed req-df7b61ae-a8f9-48bb-88b7-2f31ec5c92ef service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:17.901952 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-8de56c7e-57fe-48b6-8d4d-bcf9d3c59eed req-df7b61ae-a8f9-48bb-88b7-2f31ec5c92ef service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:17.931314 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-02788709-7d42-4293-9baf-b2809922ab89 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:17.932809 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-02788709-7d42-4293-9baf-b2809922ab89 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:17.934655 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-8de56c7e-57fe-48b6-8d4d-bcf9d3c59eed req-df7b61ae-a8f9-48bb-88b7-2f31ec5c92ef service nova] Creating event network-vif-plugged:249b2651-5483-475a-b81d-a745b21a7e43 for instance 4eafd976-e41c-44be-8b8e-358dd69f371d on hv-cinder-82002 Jan 19 16:03:17.936522 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-8de56c7e-57fe-48b6-8d4d-bcf9d3c59eed req-df7b61ae-a8f9-48bb-88b7-2f31ec5c92ef service nova] Creating event network-vif-plugged:c7242af9-f303-413b-adb2-3e898621610a for instance a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a on hv-cinder-82002 Jan 19 16:03:17.936522 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-8de56c7e-57fe-48b6-8d4d-bcf9d3c59eed req-df7b61ae-a8f9-48bb-88b7-2f31ec5c92ef service nova] Creating event network-vif-plugged:0c10b593-ffa7-45ab-aae4-22eb81766637 for instance d843b329-8449-4eb9-9d5b-a12764773e75 on hv-cinder-82002 Jan 19 16:03:17.937321 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-8de56c7e-57fe-48b6-8d4d-bcf9d3c59eed req-df7b61ae-a8f9-48bb-88b7-2f31ec5c92ef service nova] Creating event network-vif-plugged:eccf3abd-c626-40ae-a8b0-a9dcdf81545f for instance cf8c20cd-e1b6-415c-9811-c58dbcf31b49 on hv-cinder-82002 Jan 19 16:03:17.941096 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-02788709-7d42-4293-9baf-b2809922ab89 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:17.941843 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-02788709-7d42-4293-9baf-b2809922ab89 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:17.942893 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-02788709-7d42-4293-9baf-b2809922ab89 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:17.943705 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-02788709-7d42-4293-9baf-b2809922ab89 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:17.994817 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-8de56c7e-57fe-48b6-8d4d-bcf9d3c59eed req-df7b61ae-a8f9-48bb-88b7-2f31ec5c92ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.120948 Jan 19 16:03:17.997763 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 69/143] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:03:18.249291 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6ed0c83d-3fc1-4148-b40b-e5e9ea71eebd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:18.250246 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-6ed0c83d-3fc1-4148-b40b-e5e9ea71eebd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:18.276409 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6ed0c83d-3fc1-4148-b40b-e5e9ea71eebd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:18.276872 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6ed0c83d-3fc1-4148-b40b-e5e9ea71eebd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:18.281034 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6ed0c83d-3fc1-4148-b40b-e5e9ea71eebd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:18.284467 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6ed0c83d-3fc1-4148-b40b-e5e9ea71eebd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:18.317293 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-02788709-7d42-4293-9baf-b2809922ab89 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:18.347479 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-02788709-7d42-4293-9baf-b2809922ab89 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1322 microversion: 2.1 time: 0.419210 Jan 19 16:03:18.359402 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 75/144] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:17 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1322 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:18.382761 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-23796e7b-fba0-4f48-b56d-9e65db6aa69a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:18.383640 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-23796e7b-fba0-4f48-b56d-9e65db6aa69a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:18.398609 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-23796e7b-fba0-4f48-b56d-9e65db6aa69a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:18.400471 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-23796e7b-fba0-4f48-b56d-9e65db6aa69a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:18.402403 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-23796e7b-fba0-4f48-b56d-9e65db6aa69a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:18.403940 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-23796e7b-fba0-4f48-b56d-9e65db6aa69a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:18.642642 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-23796e7b-fba0-4f48-b56d-9e65db6aa69a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:18.656678 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-23796e7b-fba0-4f48-b56d-9e65db6aa69a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:18.658381 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-23796e7b-fba0-4f48-b56d-9e65db6aa69a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:18.665626 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-23796e7b-fba0-4f48-b56d-9e65db6aa69a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1404 microversion: 2.20 time: 0.290823 Jan 19 16:03:18.666236 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 76/145] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:03:18 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1404 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:03:18.802407 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6ed0c83d-3fc1-4148-b40b-e5e9ea71eebd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:18.815925 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6ed0c83d-3fc1-4148-b40b-e5e9ea71eebd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1363 microversion: 2.1 time: 0.570096 Jan 19 16:03:18.816691 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 70/146] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:18 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1363 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:18.881989 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a36cbfc1-2d6f-4c5d-8619-76943c5286c8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:18.886803 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a36cbfc1-2d6f-4c5d-8619-76943c5286c8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:18.906013 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a36cbfc1-2d6f-4c5d-8619-76943c5286c8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:18.906013 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a36cbfc1-2d6f-4c5d-8619-76943c5286c8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:18.907070 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a36cbfc1-2d6f-4c5d-8619-76943c5286c8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:18.908196 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a36cbfc1-2d6f-4c5d-8619-76943c5286c8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:18.916679 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-a500199e-4e62-447a-9ee1-ef5b7ad6d77a tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:18.925227 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-a500199e-4e62-447a-9ee1-ef5b7ad6d77a tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:18.925227 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a500199e-4e62-447a-9ee1-ef5b7ad6d77a tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:18.925906 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a500199e-4e62-447a-9ee1-ef5b7ad6d77a tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:18.926734 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a500199e-4e62-447a-9ee1-ef5b7ad6d77a tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:18.928228 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a500199e-4e62-447a-9ee1-ef5b7ad6d77a tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:19.102129 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-a500199e-4e62-447a-9ee1-ef5b7ad6d77a tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:19.112602 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-a500199e-4e62-447a-9ee1-ef5b7ad6d77a tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1314 microversion: 2.1 time: 0.200812 Jan 19 16:03:19.113838 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 71/147] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:18 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:19.133744 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a36cbfc1-2d6f-4c5d-8619-76943c5286c8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:19.143773 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a36cbfc1-2d6f-4c5d-8619-76943c5286c8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1316 microversion: 2.1 time: 0.276713 Jan 19 16:03:19.144751 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 77/148] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:18 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1316 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:19.366318 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-1fcafab6-fb20-43b7-9688-adb0e693ae5a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:19.367503 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-1fcafab6-fb20-43b7-9688-adb0e693ae5a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:19.376069 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1fcafab6-fb20-43b7-9688-adb0e693ae5a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:19.376917 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1fcafab6-fb20-43b7-9688-adb0e693ae5a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:19.378952 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1fcafab6-fb20-43b7-9688-adb0e693ae5a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:19.379853 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1fcafab6-fb20-43b7-9688-adb0e693ae5a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:19.594624 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-1fcafab6-fb20-43b7-9688-adb0e693ae5a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:19.612364 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-1fcafab6-fb20-43b7-9688-adb0e693ae5a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1322 microversion: 2.1 time: 0.241170 Jan 19 16:03:19.612364 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 72/149] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:19 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:19.691284 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f92a8a43-6c82-49d2-9ee7-36c621ac2694 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:19.691918 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f92a8a43-6c82-49d2-9ee7-36c621ac2694 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:19.698507 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f92a8a43-6c82-49d2-9ee7-36c621ac2694 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:19.698958 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f92a8a43-6c82-49d2-9ee7-36c621ac2694 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:19.699852 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f92a8a43-6c82-49d2-9ee7-36c621ac2694 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:19.700418 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f92a8a43-6c82-49d2-9ee7-36c621ac2694 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:19.838251 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-9b18ea3a-cffe-43e6-92a0-b8202bfad6ee tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:19.839439 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-9b18ea3a-cffe-43e6-92a0-b8202bfad6ee tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:19.850428 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9b18ea3a-cffe-43e6-92a0-b8202bfad6ee tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:19.851595 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9b18ea3a-cffe-43e6-92a0-b8202bfad6ee tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:19.853080 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9b18ea3a-cffe-43e6-92a0-b8202bfad6ee tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:19.853886 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9b18ea3a-cffe-43e6-92a0-b8202bfad6ee tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:20.055410 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f92a8a43-6c82-49d2-9ee7-36c621ac2694 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:20.059513 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f92a8a43-6c82-49d2-9ee7-36c621ac2694 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:20.061029 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f92a8a43-6c82-49d2-9ee7-36c621ac2694 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:20.062160 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f92a8a43-6c82-49d2-9ee7-36c621ac2694 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1404 microversion: 2.20 time: 0.376074 Jan 19 16:03:20.062888 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 78/150] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:03:19 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1404 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:03:20.072369 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-eb4dd265-f699-4730-8866-5a1b9606e4c0 req-993dfca8-db9e-49e9-a0dc-9969ac78a4af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02ba601a-94e7-486f-9d1b-7418ae534f4f", "name": "network-vif-plugged", "status": "completed", "tag": "51ed4245-58bf-4cc7-838e-9cad3734639e"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:20.075633 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:03:20.075633 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:03:20.087396 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-eb4dd265-f699-4730-8866-5a1b9606e4c0 req-993dfca8-db9e-49e9-a0dc-9969ac78a4af service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:20.088687 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-eb4dd265-f699-4730-8866-5a1b9606e4c0 req-993dfca8-db9e-49e9-a0dc-9969ac78a4af service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:20.090090 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-9b18ea3a-cffe-43e6-92a0-b8202bfad6ee tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:20.100844 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-9b18ea3a-cffe-43e6-92a0-b8202bfad6ee tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1363 microversion: 2.1 time: 0.269621 Jan 19 16:03:20.103341 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 73/151] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:19 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:20.114757 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-eb4dd265-f699-4730-8866-5a1b9606e4c0 req-993dfca8-db9e-49e9-a0dc-9969ac78a4af service nova] Creating event network-vif-plugged:51ed4245-58bf-4cc7-838e-9cad3734639e for instance 02ba601a-94e7-486f-9d1b-7418ae534f4f on hv-cinder-82002 Jan 19 16:03:20.120962 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-eb4dd265-f699-4730-8866-5a1b9606e4c0 req-993dfca8-db9e-49e9-a0dc-9969ac78a4af service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056691 Jan 19 16:03:20.131655 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-587baaf3-f2f8-49f1-97e2-2c71ac114598 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:20.132322 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-587baaf3-f2f8-49f1-97e2-2c71ac114598 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:20.135473 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 79/152] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:03:20.141025 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-587baaf3-f2f8-49f1-97e2-2c71ac114598 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:20.141763 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-587baaf3-f2f8-49f1-97e2-2c71ac114598 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:20.143001 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-587baaf3-f2f8-49f1-97e2-2c71ac114598 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:20.143693 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-587baaf3-f2f8-49f1-97e2-2c71ac114598 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:20.164854 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ca4bd463-9c79-4b96-83b1-a402ea09d9ab tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:20.169292 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ca4bd463-9c79-4b96-83b1-a402ea09d9ab tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:20.192175 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ca4bd463-9c79-4b96-83b1-a402ea09d9ab tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:20.192712 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ca4bd463-9c79-4b96-83b1-a402ea09d9ab tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:20.194509 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ca4bd463-9c79-4b96-83b1-a402ea09d9ab tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:20.195471 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ca4bd463-9c79-4b96-83b1-a402ea09d9ab tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:20.384289 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-587baaf3-f2f8-49f1-97e2-2c71ac114598 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:20.413927 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-587baaf3-f2f8-49f1-97e2-2c71ac114598 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1314 microversion: 2.1 time: 0.283411 Jan 19 16:03:20.418311 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 74/153] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:20 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:20.456339 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ca4bd463-9c79-4b96-83b1-a402ea09d9ab tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:20.471276 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ca4bd463-9c79-4b96-83b1-a402ea09d9ab tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1316 microversion: 2.1 time: 0.312137 Jan 19 16:03:20.472343 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 80/154] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:20 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1316 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:20.633428 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-dcad8811-21ed-4d00-ade9-9aef6e8a56f2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:20.635628 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-dcad8811-21ed-4d00-ade9-9aef6e8a56f2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:20.655042 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-dcad8811-21ed-4d00-ade9-9aef6e8a56f2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:20.655810 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-dcad8811-21ed-4d00-ade9-9aef6e8a56f2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:20.657529 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-dcad8811-21ed-4d00-ade9-9aef6e8a56f2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:20.658600 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-dcad8811-21ed-4d00-ade9-9aef6e8a56f2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:20.902922 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-dcad8811-21ed-4d00-ade9-9aef6e8a56f2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:20.917957 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-dcad8811-21ed-4d00-ade9-9aef6e8a56f2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1322 microversion: 2.1 time: 0.292268 Jan 19 16:03:20.918958 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 75/155] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:20 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:21.081206 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-dfabd8ee-67ba-4dc9-8493-aef1fe0336c2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:21.081820 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-dfabd8ee-67ba-4dc9-8493-aef1fe0336c2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:21.088196 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dfabd8ee-67ba-4dc9-8493-aef1fe0336c2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:21.088638 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dfabd8ee-67ba-4dc9-8493-aef1fe0336c2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:21.089440 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dfabd8ee-67ba-4dc9-8493-aef1fe0336c2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:21.089871 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dfabd8ee-67ba-4dc9-8493-aef1fe0336c2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:21.132463 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-8c5c3527-508b-46b2-8280-16f56b581f80 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:21.136245 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8c5c3527-508b-46b2-8280-16f56b581f80 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:21.151542 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8c5c3527-508b-46b2-8280-16f56b581f80 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:21.153999 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8c5c3527-508b-46b2-8280-16f56b581f80 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:21.155909 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8c5c3527-508b-46b2-8280-16f56b581f80 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:21.156797 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8c5c3527-508b-46b2-8280-16f56b581f80 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:21.275163 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-dfabd8ee-67ba-4dc9-8493-aef1fe0336c2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:21.288142 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-dfabd8ee-67ba-4dc9-8493-aef1fe0336c2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:21.289951 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-dfabd8ee-67ba-4dc9-8493-aef1fe0336c2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:21.291435 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-dfabd8ee-67ba-4dc9-8493-aef1fe0336c2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1404 microversion: 2.20 time: 0.213922 Jan 19 16:03:21.292185 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 81/156] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:03:21 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1404 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:03:21.380994 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8c5c3527-508b-46b2-8280-16f56b581f80 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:21.394590 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-8c5c3527-508b-46b2-8280-16f56b581f80 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1363 microversion: 2.1 time: 0.279290 Jan 19 16:03:21.395698 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 76/157] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:21 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1363 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:21.438223 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-35c1baca-49ff-47fd-aa07-f0e132f28966 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:21.439019 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-35c1baca-49ff-47fd-aa07-f0e132f28966 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:21.446344 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-35c1baca-49ff-47fd-aa07-f0e132f28966 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:21.446856 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-35c1baca-49ff-47fd-aa07-f0e132f28966 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:21.448084 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-35c1baca-49ff-47fd-aa07-f0e132f28966 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:21.448576 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-35c1baca-49ff-47fd-aa07-f0e132f28966 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:21.506138 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-b411a85f-dbc1-4066-af12-6b3fce66fb30 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:21.509419 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-b411a85f-dbc1-4066-af12-6b3fce66fb30 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:21.527353 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b411a85f-dbc1-4066-af12-6b3fce66fb30 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:21.528011 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b411a85f-dbc1-4066-af12-6b3fce66fb30 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:21.528903 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b411a85f-dbc1-4066-af12-6b3fce66fb30 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:21.529410 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b411a85f-dbc1-4066-af12-6b3fce66fb30 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:21.732870 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-35c1baca-49ff-47fd-aa07-f0e132f28966 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:21.766639 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-35c1baca-49ff-47fd-aa07-f0e132f28966 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1314 microversion: 2.1 time: 0.331267 Jan 19 16:03:21.771908 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 82/158] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:21 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:21.816981 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-b411a85f-dbc1-4066-af12-6b3fce66fb30 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:21.825193 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-b411a85f-dbc1-4066-af12-6b3fce66fb30 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1316 microversion: 2.1 time: 0.325062 Jan 19 16:03:21.825959 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 77/159] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:21 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1316 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:21.947674 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3ed66873-f404-40f5-8c0e-caa5df7aa5a2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:21.948605 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3ed66873-f404-40f5-8c0e-caa5df7aa5a2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:21.956404 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3ed66873-f404-40f5-8c0e-caa5df7aa5a2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:21.956996 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3ed66873-f404-40f5-8c0e-caa5df7aa5a2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:21.957915 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3ed66873-f404-40f5-8c0e-caa5df7aa5a2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:21.958652 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3ed66873-f404-40f5-8c0e-caa5df7aa5a2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:22.183281 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-3ed66873-f404-40f5-8c0e-caa5df7aa5a2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:22.203019 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3ed66873-f404-40f5-8c0e-caa5df7aa5a2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1322 microversion: 2.1 time: 0.266246 Jan 19 16:03:22.204266 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 83/160] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:21 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:22.310157 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-76e8857d-cf08-4e07-968a-f1fac56906b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:22.310764 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-76e8857d-cf08-4e07-968a-f1fac56906b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:22.316959 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-76e8857d-cf08-4e07-968a-f1fac56906b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:22.317472 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-76e8857d-cf08-4e07-968a-f1fac56906b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:22.318353 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-76e8857d-cf08-4e07-968a-f1fac56906b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:22.318772 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-76e8857d-cf08-4e07-968a-f1fac56906b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:22.414897 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-bfec603f-6f40-4931-bcea-ada1907cf367 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:22.415601 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-bfec603f-6f40-4931-bcea-ada1907cf367 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:22.422612 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bfec603f-6f40-4931-bcea-ada1907cf367 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:22.422985 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bfec603f-6f40-4931-bcea-ada1907cf367 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:22.426065 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bfec603f-6f40-4931-bcea-ada1907cf367 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:22.426065 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bfec603f-6f40-4931-bcea-ada1907cf367 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:22.476727 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-76e8857d-cf08-4e07-968a-f1fac56906b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:22.488360 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-76e8857d-cf08-4e07-968a-f1fac56906b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:22.490474 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-76e8857d-cf08-4e07-968a-f1fac56906b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:22.491812 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-76e8857d-cf08-4e07-968a-f1fac56906b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1404 microversion: 2.20 time: 0.185311 Jan 19 16:03:22.492940 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 78/161] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:03:22 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1404 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:03:22.603108 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-bfec603f-6f40-4931-bcea-ada1907cf367 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:22.615064 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-bfec603f-6f40-4931-bcea-ada1907cf367 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1549 microversion: 2.1 time: 0.204392 Jan 19 16:03:22.615653 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 84/162] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:22 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1549 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:22.637048 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-88e8708e-6ad7-4534-b6d0-9899ac733db1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:22.637923 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-88e8708e-6ad7-4534-b6d0-9899ac733db1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:22.644895 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-88e8708e-6ad7-4534-b6d0-9899ac733db1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:22.645336 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-88e8708e-6ad7-4534-b6d0-9899ac733db1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:22.646122 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-88e8708e-6ad7-4534-b6d0-9899ac733db1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:22.646582 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-88e8708e-6ad7-4534-b6d0-9899ac733db1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:22.780019 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-88e8708e-6ad7-4534-b6d0-9899ac733db1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.150843 Jan 19 16:03:22.780734 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 79/163] 10.222.0.58 () {58 vars in 1274 bytes} [Wed Jan 19 16:03:22 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/os-interface => generated 285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:03:22.796238 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-45bc15d2-55c6-4862-9d3c-2b0c861dfe3c tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:22.797082 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-45bc15d2-55c6-4862-9d3c-2b0c861dfe3c tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:22.804375 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-45bc15d2-55c6-4862-9d3c-2b0c861dfe3c tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:22.805091 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-45bc15d2-55c6-4862-9d3c-2b0c861dfe3c tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:22.813505 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-45bc15d2-55c6-4862-9d3c-2b0c861dfe3c tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:22.813505 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-45bc15d2-55c6-4862-9d3c-2b0c861dfe3c tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:22.843356 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-0632ca7e-15b7-4784-89dc-2be440bbcc42 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:22.847716 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-0632ca7e-15b7-4784-89dc-2be440bbcc42 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:22.851719 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0632ca7e-15b7-4784-89dc-2be440bbcc42 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:22.852454 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0632ca7e-15b7-4784-89dc-2be440bbcc42 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:22.853586 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0632ca7e-15b7-4784-89dc-2be440bbcc42 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:22.854087 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0632ca7e-15b7-4784-89dc-2be440bbcc42 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:23.009095 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-45bc15d2-55c6-4862-9d3c-2b0c861dfe3c tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:23.018734 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-45bc15d2-55c6-4862-9d3c-2b0c861dfe3c tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1501 microversion: 2.1 time: 0.226257 Jan 19 16:03:23.019479 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 85/164] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:22 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1501 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:23.228232 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8a5644a5-e07a-4a1b-bf7c-fde43342ac58 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:23.228890 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-8a5644a5-e07a-4a1b-bf7c-fde43342ac58 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:23.241961 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8a5644a5-e07a-4a1b-bf7c-fde43342ac58 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:23.242529 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8a5644a5-e07a-4a1b-bf7c-fde43342ac58 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:23.243371 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8a5644a5-e07a-4a1b-bf7c-fde43342ac58 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:23.244006 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8a5644a5-e07a-4a1b-bf7c-fde43342ac58 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:23.269643 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-0632ca7e-15b7-4784-89dc-2be440bbcc42 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:23.296838 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-0632ca7e-15b7-4784-89dc-2be440bbcc42 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1506 microversion: 2.1 time: 0.455379 Jan 19 16:03:23.298408 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 80/165] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:22 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:23.510720 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d7d75e6b-3ca0-46ea-9281-9ae0e24358b7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:23.511835 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d7d75e6b-3ca0-46ea-9281-9ae0e24358b7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:23.515023 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8a5644a5-e07a-4a1b-bf7c-fde43342ac58 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:23.526799 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-8a5644a5-e07a-4a1b-bf7c-fde43342ac58 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1515 microversion: 2.1 time: 0.302713 Jan 19 16:03:23.528056 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 86/166] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:23 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1515 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:23.538183 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d7d75e6b-3ca0-46ea-9281-9ae0e24358b7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:23.538913 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d7d75e6b-3ca0-46ea-9281-9ae0e24358b7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:23.539947 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d7d75e6b-3ca0-46ea-9281-9ae0e24358b7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:23.540573 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d7d75e6b-3ca0-46ea-9281-9ae0e24358b7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:23.557226 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-0841d765-50b4-4afd-9ac9-7b6ba71de9f6 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:23.558532 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-0841d765-50b4-4afd-9ac9-7b6ba71de9f6 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:23.567204 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0841d765-50b4-4afd-9ac9-7b6ba71de9f6 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:23.567654 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0841d765-50b4-4afd-9ac9-7b6ba71de9f6 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:23.568471 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0841d765-50b4-4afd-9ac9-7b6ba71de9f6 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:23.568905 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0841d765-50b4-4afd-9ac9-7b6ba71de9f6 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:23.724937 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.objects.instance [None req-0841d765-50b4-4afd-9ac9-7b6ba71de9f6 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lazy-loading 'flavor' on Instance uuid 4eafd976-e41c-44be-8b8e-358dd69f371d {{(pid=128876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:03:24.240187 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d7d75e6b-3ca0-46ea-9281-9ae0e24358b7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:24.253045 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d7d75e6b-3ca0-46ea-9281-9ae0e24358b7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:24.254563 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d7d75e6b-3ca0-46ea-9281-9ae0e24358b7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:24.255856 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d7d75e6b-3ca0-46ea-9281-9ae0e24358b7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1595 microversion: 2.20 time: 0.748831 Jan 19 16:03:24.267070 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 81/167] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:03:23 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1595 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:03:24.276358 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-18f42973-15cf-4d63-a199-a1db1b35dc5f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:24.277481 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-18f42973-15cf-4d63-a199-a1db1b35dc5f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:24.284134 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-18f42973-15cf-4d63-a199-a1db1b35dc5f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:24.284584 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-18f42973-15cf-4d63-a199-a1db1b35dc5f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:24.285569 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-18f42973-15cf-4d63-a199-a1db1b35dc5f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:24.286004 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-18f42973-15cf-4d63-a199-a1db1b35dc5f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:24.348309 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-0841d765-50b4-4afd-9ac9-7b6ba71de9f6 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "POST /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d/action" status: 200 len: 32 microversion: 2.1 time: 0.794777 Jan 19 16:03:24.352516 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 87/168] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:03:23 2022] POST /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d/action => generated 32 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:03:24.367596 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-0d1c6980-4503-4c89-9bab-417ea7888389 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:24.368359 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-0d1c6980-4503-4c89-9bab-417ea7888389 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:24.377681 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0d1c6980-4503-4c89-9bab-417ea7888389 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:24.378147 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0d1c6980-4503-4c89-9bab-417ea7888389 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:24.378937 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0d1c6980-4503-4c89-9bab-417ea7888389 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:24.379389 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0d1c6980-4503-4c89-9bab-417ea7888389 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:24.524582 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-18f42973-15cf-4d63-a199-a1db1b35dc5f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.252285 Jan 19 16:03:24.527694 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 82/169] 10.222.0.58 () {60 vars in 1315 bytes} [Wed Jan 19 16:03:24 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/os-interface => generated 284 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:03:24.755360 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-0d1c6980-4503-4c89-9bab-417ea7888389 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:24.769012 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-0d1c6980-4503-4c89-9bab-417ea7888389 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.411647 Jan 19 16:03:24.770522 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 88/170] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:24 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:25.533141 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-84038857-3143-40b2-ad85-0575ed01de40 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:25.534283 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-84038857-3143-40b2-ad85-0575ed01de40 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:25.541389 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-84038857-3143-40b2-ad85-0575ed01de40 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:25.542024 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-84038857-3143-40b2-ad85-0575ed01de40 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:25.542942 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-84038857-3143-40b2-ad85-0575ed01de40 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:25.543504 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-84038857-3143-40b2-ad85-0575ed01de40 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:25.649467 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-2ee2d592-6c8f-4b4d-875e-6fd5a7792007 req-4e17d558-089a-47b9-98b3-2ebcef77a145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a", "tag": "c7242af9-f303-413b-adb2-3e898621610a"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:25.652919 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:03:25.652919 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:03:25.671128 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-2ee2d592-6c8f-4b4d-875e-6fd5a7792007 req-4e17d558-089a-47b9-98b3-2ebcef77a145 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:25.672159 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-2ee2d592-6c8f-4b4d-875e-6fd5a7792007 req-4e17d558-089a-47b9-98b3-2ebcef77a145 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:25.701451 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-2ee2d592-6c8f-4b4d-875e-6fd5a7792007 req-4e17d558-089a-47b9-98b3-2ebcef77a145 service nova] Creating event network-changed:c7242af9-f303-413b-adb2-3e898621610a for instance a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a on hv-cinder-82002 Jan 19 16:03:25.720147 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-2ee2d592-6c8f-4b4d-875e-6fd5a7792007 req-4e17d558-089a-47b9-98b3-2ebcef77a145 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076040 Jan 19 16:03:25.723470 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 89/171] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:03:25.795639 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f4ab5e15-8694-4a6f-a14e-c0ff3a8aedc2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:25.795639 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f4ab5e15-8694-4a6f-a14e-c0ff3a8aedc2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:25.801861 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f4ab5e15-8694-4a6f-a14e-c0ff3a8aedc2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:25.802308 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f4ab5e15-8694-4a6f-a14e-c0ff3a8aedc2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:25.813826 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f4ab5e15-8694-4a6f-a14e-c0ff3a8aedc2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:25.813826 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f4ab5e15-8694-4a6f-a14e-c0ff3a8aedc2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:26.063491 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f4ab5e15-8694-4a6f-a14e-c0ff3a8aedc2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:26.076598 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f4ab5e15-8694-4a6f-a14e-c0ff3a8aedc2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.291337 Jan 19 16:03:26.079159 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 90/172] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:25 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:26.086669 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-298406f7-2d7e-4e3b-bbe8-3314ad905cd7 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aeb15f2d-832a-4b72-9a3d-483460861634"}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:26.091174 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-298406f7-2d7e-4e3b-bbe8-3314ad905cd7 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:26.096622 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-298406f7-2d7e-4e3b-bbe8-3314ad905cd7 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:26.097395 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-298406f7-2d7e-4e3b-bbe8-3314ad905cd7 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:26.098352 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-298406f7-2d7e-4e3b-bbe8-3314ad905cd7 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:26.099241 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-298406f7-2d7e-4e3b-bbe8-3314ad905cd7 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:27.197129 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-84038857-3143-40b2-ad85-0575ed01de40 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 14 microversion: 2.1 time: 1.669426 Jan 19 16:03:27.199127 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 83/173] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:03:25 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 14 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:03:27.246524 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-8a1807e2-4d6d-4f9b-8183-c2be6f67494c req-ebface41-8299-44eb-a2cf-9279183c0d65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02ba601a-94e7-486f-9d1b-7418ae534f4f", "tag": "51ed4245-58bf-4cc7-838e-9cad3734639e"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:27.246524 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:03:27.246524 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:03:27.254487 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-8a1807e2-4d6d-4f9b-8183-c2be6f67494c req-ebface41-8299-44eb-a2cf-9279183c0d65 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:27.255852 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-8a1807e2-4d6d-4f9b-8183-c2be6f67494c req-ebface41-8299-44eb-a2cf-9279183c0d65 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:27.280338 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-8a1807e2-4d6d-4f9b-8183-c2be6f67494c req-ebface41-8299-44eb-a2cf-9279183c0d65 service nova] Creating event network-changed:51ed4245-58bf-4cc7-838e-9cad3734639e for instance 02ba601a-94e7-486f-9d1b-7418ae534f4f on hv-cinder-82002 Jan 19 16:03:27.292758 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-8a1807e2-4d6d-4f9b-8183-c2be6f67494c req-ebface41-8299-44eb-a2cf-9279183c0d65 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090629 Jan 19 16:03:27.295572 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 84/174] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:03:27.306826 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-82302bda-cab4-4463-b1e4-464d166ae01b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:27.312101 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-82302bda-cab4-4463-b1e4-464d166ae01b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:27.324335 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-82302bda-cab4-4463-b1e4-464d166ae01b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:27.329247 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-82302bda-cab4-4463-b1e4-464d166ae01b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:27.329247 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-82302bda-cab4-4463-b1e4-464d166ae01b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:27.329247 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-82302bda-cab4-4463-b1e4-464d166ae01b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:29.640434 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-82302bda-cab4-4463-b1e4-464d166ae01b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 14 microversion: 2.20 time: 2.342031 Jan 19 16:03:29.646512 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 85/175] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:03:27 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 14 bytes in 2350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:29.658500 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c3b39629-8c20-4039-a807-132a37652d2a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:29.660205 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c3b39629-8c20-4039-a807-132a37652d2a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:29.674595 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c3b39629-8c20-4039-a807-132a37652d2a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:29.675749 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c3b39629-8c20-4039-a807-132a37652d2a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:29.676690 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c3b39629-8c20-4039-a807-132a37652d2a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:29.677477 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c3b39629-8c20-4039-a807-132a37652d2a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:30.349116 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c3b39629-8c20-4039-a807-132a37652d2a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:30.357204 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c3b39629-8c20-4039-a807-132a37652d2a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.708359 Jan 19 16:03:30.357969 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 86/176] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:29 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:30.363225 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6f52cc89-97ec-4f94-b8dd-de52fa3897a5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:30.364166 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-6f52cc89-97ec-4f94-b8dd-de52fa3897a5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:30.370578 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6f52cc89-97ec-4f94-b8dd-de52fa3897a5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:30.371085 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6f52cc89-97ec-4f94-b8dd-de52fa3897a5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:30.371876 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6f52cc89-97ec-4f94-b8dd-de52fa3897a5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:30.372310 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6f52cc89-97ec-4f94-b8dd-de52fa3897a5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:31.122790 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-298406f7-2d7e-4e3b-bbe8-3314ad905cd7 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "POST /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.041252 Jan 19 16:03:31.128525 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 91/177] 10.222.0.58 () {60 vars in 1322 bytes} [Wed Jan 19 16:03:26 2022] POST /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75/os-volume_attachments => generated 194 bytes in 5044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:03:31.129230 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-4e3b08e2-b310-4616-a14a-0cba73f7a4b2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:31.131337 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-4e3b08e2-b310-4616-a14a-0cba73f7a4b2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:31.138480 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4e3b08e2-b310-4616-a14a-0cba73f7a4b2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:31.139931 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4e3b08e2-b310-4616-a14a-0cba73f7a4b2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:31.141087 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4e3b08e2-b310-4616-a14a-0cba73f7a4b2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:31.141724 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4e3b08e2-b310-4616-a14a-0cba73f7a4b2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:33.873762 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-4e3b08e2-b310-4616-a14a-0cba73f7a4b2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 14 microversion: 2.20 time: 2.748707 Jan 19 16:03:33.876686 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6f52cc89-97ec-4f94-b8dd-de52fa3897a5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 14 microversion: 2.1 time: 3.517438 Jan 19 16:03:33.877918 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 92/178] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:03:31 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 14 bytes in 2753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:33.884393 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 87/179] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:03:30 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 14 bytes in 3526 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:03:33.891684 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-2b056103-628b-4bce-899f-081b7a067c5f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:33.893714 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-2b056103-628b-4bce-899f-081b7a067c5f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:33.903306 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2b056103-628b-4bce-899f-081b7a067c5f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:33.904047 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2b056103-628b-4bce-899f-081b7a067c5f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:33.905040 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2b056103-628b-4bce-899f-081b7a067c5f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:33.905651 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2b056103-628b-4bce-899f-081b7a067c5f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:34.099777 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-2b056103-628b-4bce-899f-081b7a067c5f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:34.124123 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-2b056103-628b-4bce-899f-081b7a067c5f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.233542 Jan 19 16:03:34.124123 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 93/180] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:33 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:34.886183 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-cda4ebb7-0e1a-494b-b9c0-2cf95418dbfc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:34.887546 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-cda4ebb7-0e1a-494b-b9c0-2cf95418dbfc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:34.889893 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-fd415204-7d29-4e78-b8fb-0a328abf6c6e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:34.890827 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-fd415204-7d29-4e78-b8fb-0a328abf6c6e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:34.895956 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cda4ebb7-0e1a-494b-b9c0-2cf95418dbfc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:34.896868 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cda4ebb7-0e1a-494b-b9c0-2cf95418dbfc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:34.897954 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fd415204-7d29-4e78-b8fb-0a328abf6c6e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:34.898134 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cda4ebb7-0e1a-494b-b9c0-2cf95418dbfc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:34.898450 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fd415204-7d29-4e78-b8fb-0a328abf6c6e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:34.898713 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cda4ebb7-0e1a-494b-b9c0-2cf95418dbfc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:34.899413 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fd415204-7d29-4e78-b8fb-0a328abf6c6e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:34.899859 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fd415204-7d29-4e78-b8fb-0a328abf6c6e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:34.972442 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-fd415204-7d29-4e78-b8fb-0a328abf6c6e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 14 microversion: 2.1 time: 0.086370 Jan 19 16:03:34.973114 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 94/181] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:03:34 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 16:03:34.980420 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-cda4ebb7-0e1a-494b-b9c0-2cf95418dbfc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 14 microversion: 2.20 time: 0.098311 Jan 19 16:03:34.980971 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 88/182] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:03:34 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:35.133262 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-0286b624-b90d-4f27-9232-3463276ea8dc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:35.134115 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-0286b624-b90d-4f27-9232-3463276ea8dc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:35.143894 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0286b624-b90d-4f27-9232-3463276ea8dc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:35.144453 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0286b624-b90d-4f27-9232-3463276ea8dc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:35.145286 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0286b624-b90d-4f27-9232-3463276ea8dc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:35.145676 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0286b624-b90d-4f27-9232-3463276ea8dc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:35.350402 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-0286b624-b90d-4f27-9232-3463276ea8dc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:35.366246 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-0286b624-b90d-4f27-9232-3463276ea8dc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.236636 Jan 19 16:03:35.368800 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 95/183] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:35 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:35.984878 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-65f4df12-61f2-4943-be4e-68a02c5b5034 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:35.986718 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-65f4df12-61f2-4943-be4e-68a02c5b5034 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:35.992244 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8799ec73-d151-4456-ae76-03b716046152 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:35.993221 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-8799ec73-d151-4456-ae76-03b716046152 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:36.001121 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8799ec73-d151-4456-ae76-03b716046152 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:36.001663 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8799ec73-d151-4456-ae76-03b716046152 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:36.008160 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8799ec73-d151-4456-ae76-03b716046152 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:36.008471 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-65f4df12-61f2-4943-be4e-68a02c5b5034 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:36.008579 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8799ec73-d151-4456-ae76-03b716046152 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:36.008667 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-65f4df12-61f2-4943-be4e-68a02c5b5034 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:36.008667 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-65f4df12-61f2-4943-be4e-68a02c5b5034 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:36.008667 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-65f4df12-61f2-4943-be4e-68a02c5b5034 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:36.090454 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-8799ec73-d151-4456-ae76-03b716046152 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 14 microversion: 2.20 time: 0.101778 Jan 19 16:03:36.091488 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 96/184] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:03:35 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:36.100303 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-65f4df12-61f2-4943-be4e-68a02c5b5034 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 14 microversion: 2.1 time: 0.120885 Jan 19 16:03:36.103493 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 89/185] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:03:35 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 16:03:36.269747 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-701c0f88-911b-419e-a8d5-1b36b3be7573 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acd4a663-e19d-4a10-bdc1-0c982e720727"}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:36.269747 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-701c0f88-911b-419e-a8d5-1b36b3be7573 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:36.273788 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-701c0f88-911b-419e-a8d5-1b36b3be7573 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:36.274274 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-701c0f88-911b-419e-a8d5-1b36b3be7573 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:36.275144 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-701c0f88-911b-419e-a8d5-1b36b3be7573 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:36.275639 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-701c0f88-911b-419e-a8d5-1b36b3be7573 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:36.384845 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ca864ab8-76e4-45e1-834e-2368b4c6809e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:36.385565 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-ca864ab8-76e4-45e1-834e-2368b4c6809e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:36.393077 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ca864ab8-76e4-45e1-834e-2368b4c6809e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:36.395576 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ca864ab8-76e4-45e1-834e-2368b4c6809e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:36.395576 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ca864ab8-76e4-45e1-834e-2368b4c6809e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:36.395576 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ca864ab8-76e4-45e1-834e-2368b4c6809e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:36.556263 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ca864ab8-76e4-45e1-834e-2368b4c6809e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:36.570616 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-ca864ab8-76e4-45e1-834e-2368b4c6809e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.189774 Jan 19 16:03:36.572489 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 90/186] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:36 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:37.103265 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-b57ba5b6-838e-4949-ab90-451436047fe9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:37.104143 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-b57ba5b6-838e-4949-ab90-451436047fe9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:37.112971 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b57ba5b6-838e-4949-ab90-451436047fe9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:37.113489 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b57ba5b6-838e-4949-ab90-451436047fe9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:37.114326 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b57ba5b6-838e-4949-ab90-451436047fe9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:37.114809 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b57ba5b6-838e-4949-ab90-451436047fe9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:37.191113 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-701c0f88-911b-419e-a8d5-1b36b3be7573 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "POST /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.937327 Jan 19 16:03:37.192743 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 97/187] 10.222.0.58 () {60 vars in 1322 bytes} [Wed Jan 19 16:03:36 2022] POST /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49/os-volume_attachments => generated 194 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:03:37.196962 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-0f3e0be9-82ef-4923-88e9-99ea919e0f3a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:37.198018 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-0f3e0be9-82ef-4923-88e9-99ea919e0f3a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:37.206219 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0f3e0be9-82ef-4923-88e9-99ea919e0f3a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:37.206701 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0f3e0be9-82ef-4923-88e9-99ea919e0f3a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:37.207470 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0f3e0be9-82ef-4923-88e9-99ea919e0f3a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:37.207896 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0f3e0be9-82ef-4923-88e9-99ea919e0f3a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:37.215856 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-b57ba5b6-838e-4949-ab90-451436047fe9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 14 microversion: 2.20 time: 0.116299 Jan 19 16:03:37.220143 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 91/188] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:03:37 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:37.296717 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-0f3e0be9-82ef-4923-88e9-99ea919e0f3a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 2431 microversion: 2.1 time: 0.103334 Jan 19 16:03:37.302283 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 98/189] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:03:37 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 2431 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:37.593687 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-edbbb909-cb17-4af0-9e6a-4d3cfc3338a0 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:37.594422 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-edbbb909-cb17-4af0-9e6a-4d3cfc3338a0 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:37.602175 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-edbbb909-cb17-4af0-9e6a-4d3cfc3338a0 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:37.602628 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-edbbb909-cb17-4af0-9e6a-4d3cfc3338a0 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:37.603453 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-edbbb909-cb17-4af0-9e6a-4d3cfc3338a0 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:37.603878 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-edbbb909-cb17-4af0-9e6a-4d3cfc3338a0 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:37.758424 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-edbbb909-cb17-4af0-9e6a-4d3cfc3338a0 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:37.766181 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-edbbb909-cb17-4af0-9e6a-4d3cfc3338a0 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.176984 Jan 19 16:03:37.766864 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 92/190] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:37 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:38.228786 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ce2d0f16-a0f5-4352-93c3-c4c5af99afab tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:38.229725 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ce2d0f16-a0f5-4352-93c3-c4c5af99afab tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:38.240027 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ce2d0f16-a0f5-4352-93c3-c4c5af99afab tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:38.240474 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ce2d0f16-a0f5-4352-93c3-c4c5af99afab tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:38.241359 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ce2d0f16-a0f5-4352-93c3-c4c5af99afab tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:38.241776 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ce2d0f16-a0f5-4352-93c3-c4c5af99afab tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:38.311206 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-28e5eb9f-230e-4a15-ab50-e955975654d3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:38.312131 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-28e5eb9f-230e-4a15-ab50-e955975654d3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:38.318847 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-28e5eb9f-230e-4a15-ab50-e955975654d3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:38.322198 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-28e5eb9f-230e-4a15-ab50-e955975654d3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:38.322319 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ce2d0f16-a0f5-4352-93c3-c4c5af99afab tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 14 microversion: 2.20 time: 0.094865 Jan 19 16:03:38.322407 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-28e5eb9f-230e-4a15-ab50-e955975654d3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:38.322480 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 99/191] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:03:38 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:38.322546 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-28e5eb9f-230e-4a15-ab50-e955975654d3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:38.411482 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-28e5eb9f-230e-4a15-ab50-e955975654d3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 8879 microversion: 2.1 time: 0.104633 Jan 19 16:03:38.412344 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 93/192] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:03:38 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 8879 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:38.784630 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b205032d-0169-4762-bff2-7ba9bd66b5f8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:38.785341 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b205032d-0169-4762-bff2-7ba9bd66b5f8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:38.792652 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b205032d-0169-4762-bff2-7ba9bd66b5f8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:38.793092 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b205032d-0169-4762-bff2-7ba9bd66b5f8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:38.793884 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b205032d-0169-4762-bff2-7ba9bd66b5f8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:38.794318 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b205032d-0169-4762-bff2-7ba9bd66b5f8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:38.936670 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-b205032d-0169-4762-bff2-7ba9bd66b5f8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:38.945437 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b205032d-0169-4762-bff2-7ba9bd66b5f8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.165687 Jan 19 16:03:38.946030 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 100/193] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:38 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:39.334600 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-fd940aac-6ee3-41f6-a340-2e94f29c6ccf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:39.336384 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-fd940aac-6ee3-41f6-a340-2e94f29c6ccf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:39.343714 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fd940aac-6ee3-41f6-a340-2e94f29c6ccf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:39.344158 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fd940aac-6ee3-41f6-a340-2e94f29c6ccf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:39.344953 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fd940aac-6ee3-41f6-a340-2e94f29c6ccf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:39.345465 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fd940aac-6ee3-41f6-a340-2e94f29c6ccf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:39.424544 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-2c4a3ee1-4671-4163-9221-217eb5c269f6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:39.426015 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-2c4a3ee1-4671-4163-9221-217eb5c269f6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:39.434680 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2c4a3ee1-4671-4163-9221-217eb5c269f6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:39.435330 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2c4a3ee1-4671-4163-9221-217eb5c269f6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:39.436823 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2c4a3ee1-4671-4163-9221-217eb5c269f6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:39.437514 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2c4a3ee1-4671-4163-9221-217eb5c269f6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:39.452878 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-fd940aac-6ee3-41f6-a340-2e94f29c6ccf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 5988 microversion: 2.20 time: 0.125080 Jan 19 16:03:39.457065 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 94/194] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:03:39 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 5988 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:03:39.535874 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-2c4a3ee1-4671-4163-9221-217eb5c269f6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 13583 microversion: 2.1 time: 0.116853 Jan 19 16:03:39.536545 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 101/195] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:03:39 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 13583 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:03:39.965785 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f91b42d2-cabe-4694-9bcc-3a39acc1c514 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:39.966865 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-f91b42d2-cabe-4694-9bcc-3a39acc1c514 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:39.975709 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f91b42d2-cabe-4694-9bcc-3a39acc1c514 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:39.976314 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f91b42d2-cabe-4694-9bcc-3a39acc1c514 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:39.977118 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f91b42d2-cabe-4694-9bcc-3a39acc1c514 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:39.977603 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f91b42d2-cabe-4694-9bcc-3a39acc1c514 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:40.201275 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-f91b42d2-cabe-4694-9bcc-3a39acc1c514 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:40.210964 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f91b42d2-cabe-4694-9bcc-3a39acc1c514 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.249467 Jan 19 16:03:40.211670 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 95/196] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:39 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:40.465870 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e0c98e76-c525-473f-8a30-4d6800dde988 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:40.467011 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-e0c98e76-c525-473f-8a30-4d6800dde988 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:40.475072 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e0c98e76-c525-473f-8a30-4d6800dde988 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:40.475797 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e0c98e76-c525-473f-8a30-4d6800dde988 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:40.476736 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e0c98e76-c525-473f-8a30-4d6800dde988 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:40.477381 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e0c98e76-c525-473f-8a30-4d6800dde988 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:40.549510 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-345e228c-fe27-49f8-a403-f1ce6b02167c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:40.552220 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-345e228c-fe27-49f8-a403-f1ce6b02167c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:40.558444 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-345e228c-fe27-49f8-a403-f1ce6b02167c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:40.566734 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-345e228c-fe27-49f8-a403-f1ce6b02167c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:40.566734 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-345e228c-fe27-49f8-a403-f1ce6b02167c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:40.566734 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-345e228c-fe27-49f8-a403-f1ce6b02167c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:40.598349 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e0c98e76-c525-473f-8a30-4d6800dde988 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 9302 microversion: 2.20 time: 0.136796 Jan 19 16:03:40.599343 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 102/197] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:03:40 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 9302 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:03:40.662565 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-345e228c-fe27-49f8-a403-f1ce6b02167c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 16235 microversion: 2.1 time: 0.118126 Jan 19 16:03:40.674848 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 96/198] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:03:40 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 16235 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:03:41.237263 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-668cf970-88b1-4c41-a9ff-1868db932ebb tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:41.238644 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-668cf970-88b1-4c41-a9ff-1868db932ebb tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:41.249439 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-668cf970-88b1-4c41-a9ff-1868db932ebb tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:41.250029 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-668cf970-88b1-4c41-a9ff-1868db932ebb tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:41.251189 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-668cf970-88b1-4c41-a9ff-1868db932ebb tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:41.251856 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-668cf970-88b1-4c41-a9ff-1868db932ebb tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:41.419624 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-668cf970-88b1-4c41-a9ff-1868db932ebb tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:41.433186 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-668cf970-88b1-4c41-a9ff-1868db932ebb tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.205112 Jan 19 16:03:41.435440 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 103/199] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:41 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:41.610820 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-96e5382d-d443-4c5c-bbe0-ce424db2af23 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:41.612146 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-96e5382d-d443-4c5c-bbe0-ce424db2af23 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:41.619849 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-96e5382d-d443-4c5c-bbe0-ce424db2af23 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:41.620284 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-96e5382d-d443-4c5c-bbe0-ce424db2af23 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:41.621077 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-96e5382d-d443-4c5c-bbe0-ce424db2af23 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:41.621524 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-96e5382d-d443-4c5c-bbe0-ce424db2af23 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:41.688028 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d381fc92-a363-426a-a324-868a91442363 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:41.689301 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-d381fc92-a363-426a-a324-868a91442363 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:41.697436 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d381fc92-a363-426a-a324-868a91442363 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:41.697944 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d381fc92-a363-426a-a324-868a91442363 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:41.698958 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d381fc92-a363-426a-a324-868a91442363 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:41.699714 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d381fc92-a363-426a-a324-868a91442363 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:41.714597 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-96e5382d-d443-4c5c-bbe0-ce424db2af23 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 13515 microversion: 2.20 time: 0.107797 Jan 19 16:03:41.716571 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 97/200] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:03:41 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 13515 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:03:41.815666 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-d381fc92-a363-426a-a324-868a91442363 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 17781 microversion: 2.1 time: 0.130682 Jan 19 16:03:41.816882 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 104/201] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:03:41 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 17781 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:03:42.452600 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-a6bec40e-8f18-4a21-87fa-000bdb869b50 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:42.454149 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-a6bec40e-8f18-4a21-87fa-000bdb869b50 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:42.465887 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a6bec40e-8f18-4a21-87fa-000bdb869b50 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:42.466347 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a6bec40e-8f18-4a21-87fa-000bdb869b50 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:42.467211 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a6bec40e-8f18-4a21-87fa-000bdb869b50 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:42.467645 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a6bec40e-8f18-4a21-87fa-000bdb869b50 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:42.735516 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a573191b-088e-4426-824a-e20168583d8b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:42.737418 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a573191b-088e-4426-824a-e20168583d8b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:42.755944 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a573191b-088e-4426-824a-e20168583d8b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:42.755944 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a573191b-088e-4426-824a-e20168583d8b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:42.757686 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a573191b-088e-4426-824a-e20168583d8b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:42.758158 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a573191b-088e-4426-824a-e20168583d8b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:42.782232 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-a6bec40e-8f18-4a21-87fa-000bdb869b50 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:42.800081 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-a6bec40e-8f18-4a21-87fa-000bdb869b50 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.351593 Jan 19 16:03:42.810870 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 98/202] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:42 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:42.828223 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-0746a616-f146-4b21-a5b3-4b92c0c4b825 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:42.829184 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-0746a616-f146-4b21-a5b3-4b92c0c4b825 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:42.836212 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0746a616-f146-4b21-a5b3-4b92c0c4b825 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:42.836661 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0746a616-f146-4b21-a5b3-4b92c0c4b825 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:42.837471 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0746a616-f146-4b21-a5b3-4b92c0c4b825 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:42.837904 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0746a616-f146-4b21-a5b3-4b92c0c4b825 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:42.930842 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a573191b-088e-4426-824a-e20168583d8b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 16235 microversion: 2.20 time: 0.203059 Jan 19 16:03:42.931713 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 105/203] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:03:42 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 16235 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:03:42.986807 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-0746a616-f146-4b21-a5b3-4b92c0c4b825 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 17904 microversion: 2.1 time: 0.162387 Jan 19 16:03:42.987644 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 99/204] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:03:42 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 17904 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:03:43.823215 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-63532d54-4ba3-4405-807c-4f75b2eab547 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:43.824573 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-63532d54-4ba3-4405-807c-4f75b2eab547 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:43.837246 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-63532d54-4ba3-4405-807c-4f75b2eab547 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:43.837994 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-63532d54-4ba3-4405-807c-4f75b2eab547 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:43.839198 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-63532d54-4ba3-4405-807c-4f75b2eab547 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:43.839972 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-63532d54-4ba3-4405-807c-4f75b2eab547 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:43.961719 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d530892c-6b3f-4d7d-96a2-86a68ddf64f7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:43.963532 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d530892c-6b3f-4d7d-96a2-86a68ddf64f7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:43.976436 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d530892c-6b3f-4d7d-96a2-86a68ddf64f7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:43.977175 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d530892c-6b3f-4d7d-96a2-86a68ddf64f7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:43.978379 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d530892c-6b3f-4d7d-96a2-86a68ddf64f7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:43.979026 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d530892c-6b3f-4d7d-96a2-86a68ddf64f7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:44.077781 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-63532d54-4ba3-4405-807c-4f75b2eab547 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:44.096570 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-63532d54-4ba3-4405-807c-4f75b2eab547 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.280824 Jan 19 16:03:44.098410 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 106/205] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:43 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:44.109201 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d530892c-6b3f-4d7d-96a2-86a68ddf64f7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 17834 microversion: 2.20 time: 0.149179 Jan 19 16:03:44.111253 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-29fba162-e9f2-40d4-9aad-9be3fcbe7d4c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:44.112359 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 100/206] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:03:43 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 17834 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:03:44.119039 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-29fba162-e9f2-40d4-9aad-9be3fcbe7d4c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:44.134945 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-29fba162-e9f2-40d4-9aad-9be3fcbe7d4c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:44.135727 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-29fba162-e9f2-40d4-9aad-9be3fcbe7d4c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:44.137094 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-29fba162-e9f2-40d4-9aad-9be3fcbe7d4c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:44.137721 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-29fba162-e9f2-40d4-9aad-9be3fcbe7d4c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:44.257077 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-29fba162-e9f2-40d4-9aad-9be3fcbe7d4c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 19661 microversion: 2.1 time: 0.153846 Jan 19 16:03:44.257077 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 107/207] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:03:44 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 19661 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:03:45.125202 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-830bb500-2d0d-4edb-a7c2-3ef3f6e51a72 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:45.126151 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-830bb500-2d0d-4edb-a7c2-3ef3f6e51a72 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:45.128577 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-381e918c-43b7-4b1e-a7c4-d31793e8c69d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:45.130060 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-381e918c-43b7-4b1e-a7c4-d31793e8c69d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:45.136290 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-830bb500-2d0d-4edb-a7c2-3ef3f6e51a72 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:45.137179 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-830bb500-2d0d-4edb-a7c2-3ef3f6e51a72 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:45.138631 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-830bb500-2d0d-4edb-a7c2-3ef3f6e51a72 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:45.140122 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-830bb500-2d0d-4edb-a7c2-3ef3f6e51a72 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:45.147660 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-381e918c-43b7-4b1e-a7c4-d31793e8c69d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:45.148447 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-381e918c-43b7-4b1e-a7c4-d31793e8c69d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:45.150002 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-381e918c-43b7-4b1e-a7c4-d31793e8c69d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:45.150454 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-381e918c-43b7-4b1e-a7c4-d31793e8c69d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:45.297498 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-381e918c-43b7-4b1e-a7c4-d31793e8c69d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 18303 microversion: 2.20 time: 0.175085 Jan 19 16:03:45.298459 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 108/208] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:03:45 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 18303 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:03:45.310417 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-edbe2598-d451-4e9d-9708-39dca875ab60 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:45.312946 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-edbe2598-d451-4e9d-9708-39dca875ab60 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:45.325904 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-edbe2598-d451-4e9d-9708-39dca875ab60 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:45.326403 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-edbe2598-d451-4e9d-9708-39dca875ab60 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:45.328035 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-edbe2598-d451-4e9d-9708-39dca875ab60 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:45.328590 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-edbe2598-d451-4e9d-9708-39dca875ab60 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:45.361809 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-830bb500-2d0d-4edb-a7c2-3ef3f6e51a72 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:45.370247 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-830bb500-2d0d-4edb-a7c2-3ef3f6e51a72 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.249246 Jan 19 16:03:45.370840 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 101/209] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:45 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:45.377840 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-7563ddc4-3c4e-41bb-bf03-8fed4dbdbfa0 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:45.379574 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-7563ddc4-3c4e-41bb-bf03-8fed4dbdbfa0 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:45.386874 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7563ddc4-3c4e-41bb-bf03-8fed4dbdbfa0 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:45.387350 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7563ddc4-3c4e-41bb-bf03-8fed4dbdbfa0 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:45.388698 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7563ddc4-3c4e-41bb-bf03-8fed4dbdbfa0 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:45.389123 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7563ddc4-3c4e-41bb-bf03-8fed4dbdbfa0 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:45.420151 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-7563ddc4-3c4e-41bb-bf03-8fed4dbdbfa0 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Going to try to terminate instance {{(pid=128875) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:03:45.439741 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-edbe2598-d451-4e9d-9708-39dca875ab60 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 21928 microversion: 2.1 time: 0.139030 Jan 19 16:03:45.444634 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 109/210] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:03:45 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 21928 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:03:45.775493 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-7563ddc4-3c4e-41bb-bf03-8fed4dbdbfa0 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 204 len: 0 microversion: 2.1 time: 0.403277 Jan 19 16:03:45.776128 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 102/211] 10.222.0.58 () {58 vars in 1238 bytes} [Wed Jan 19 16:03:45 2022] DELETE /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:03:45.787653 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f7f2f2cd-74a0-4ab7-87d6-f89ff6e1d3c3 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:45.788468 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f7f2f2cd-74a0-4ab7-87d6-f89ff6e1d3c3 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:45.797745 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f7f2f2cd-74a0-4ab7-87d6-f89ff6e1d3c3 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:45.798716 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f7f2f2cd-74a0-4ab7-87d6-f89ff6e1d3c3 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:45.801069 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f7f2f2cd-74a0-4ab7-87d6-f89ff6e1d3c3 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:45.801069 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f7f2f2cd-74a0-4ab7-87d6-f89ff6e1d3c3 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:45.979756 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f7f2f2cd-74a0-4ab7-87d6-f89ff6e1d3c3 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:45.997591 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f7f2f2cd-74a0-4ab7-87d6-f89ff6e1d3c3 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1553 microversion: 2.1 time: 0.213311 Jan 19 16:03:45.998608 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 110/212] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:45 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1553 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:46.321470 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-5b9e61e2-fe6a-4767-b1d3-013bb8459ab6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:46.323143 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-5b9e61e2-fe6a-4767-b1d3-013bb8459ab6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:46.330988 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5b9e61e2-fe6a-4767-b1d3-013bb8459ab6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:46.331822 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5b9e61e2-fe6a-4767-b1d3-013bb8459ab6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:46.333226 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5b9e61e2-fe6a-4767-b1d3-013bb8459ab6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:46.333874 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5b9e61e2-fe6a-4767-b1d3-013bb8459ab6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:46.389699 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-6e1a9ba5-09ca-4d3e-8dda-bafb9cb4ed74 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:46.390508 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-6e1a9ba5-09ca-4d3e-8dda-bafb9cb4ed74 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:46.399716 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6e1a9ba5-09ca-4d3e-8dda-bafb9cb4ed74 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:46.400141 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6e1a9ba5-09ca-4d3e-8dda-bafb9cb4ed74 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:46.400949 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6e1a9ba5-09ca-4d3e-8dda-bafb9cb4ed74 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:46.401382 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6e1a9ba5-09ca-4d3e-8dda-bafb9cb4ed74 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:46.450733 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-5b9e61e2-fe6a-4767-b1d3-013bb8459ab6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 19661 microversion: 2.20 time: 0.132759 Jan 19 16:03:46.451790 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 103/213] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:03:46 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 19661 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:03:46.463620 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-a4668135-0952-4be5-92d8-b6ddbcfd5163 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:46.464479 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-a4668135-0952-4be5-92d8-b6ddbcfd5163 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:46.477676 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a4668135-0952-4be5-92d8-b6ddbcfd5163 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:46.478609 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a4668135-0952-4be5-92d8-b6ddbcfd5163 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:46.480210 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a4668135-0952-4be5-92d8-b6ddbcfd5163 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:46.481232 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a4668135-0952-4be5-92d8-b6ddbcfd5163 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:46.650011 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-6e1a9ba5-09ca-4d3e-8dda-bafb9cb4ed74 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:46.659876 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-6e1a9ba5-09ca-4d3e-8dda-bafb9cb4ed74 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.274857 Jan 19 16:03:46.660625 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 111/214] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:46 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:46.866447 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-a4668135-0952-4be5-92d8-b6ddbcfd5163 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 22974 microversion: 2.1 time: 0.411512 Jan 19 16:03:46.867976 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 104/215] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:03:46 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 22974 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:03:47.025761 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-0c1b3385-218c-463b-9dd0-4bb7f3cff262 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:47.026556 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-0c1b3385-218c-463b-9dd0-4bb7f3cff262 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:47.032529 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0c1b3385-218c-463b-9dd0-4bb7f3cff262 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:47.034235 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0c1b3385-218c-463b-9dd0-4bb7f3cff262 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:47.035068 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0c1b3385-218c-463b-9dd0-4bb7f3cff262 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:47.035666 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0c1b3385-218c-463b-9dd0-4bb7f3cff262 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:47.212706 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-0c1b3385-218c-463b-9dd0-4bb7f3cff262 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:47.225614 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-0c1b3385-218c-463b-9dd0-4bb7f3cff262 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1553 microversion: 2.1 time: 0.203830 Jan 19 16:03:47.235510 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 112/216] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:47 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1553 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:47.464189 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-5fa23342-b466-406b-b83f-d044b5774db9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:47.465178 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-5fa23342-b466-406b-b83f-d044b5774db9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:47.474637 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5fa23342-b466-406b-b83f-d044b5774db9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:47.475371 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5fa23342-b466-406b-b83f-d044b5774db9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:47.476477 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5fa23342-b466-406b-b83f-d044b5774db9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:47.476901 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5fa23342-b466-406b-b83f-d044b5774db9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:47.572969 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-5fa23342-b466-406b-b83f-d044b5774db9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 21507 microversion: 2.20 time: 0.112764 Jan 19 16:03:47.573922 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 105/217] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:03:47 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 21507 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:03:47.684196 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-caa84f30-ff6e-46c7-bec1-fd83d430e9ef tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:47.685032 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-caa84f30-ff6e-46c7-bec1-fd83d430e9ef tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:47.696833 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-caa84f30-ff6e-46c7-bec1-fd83d430e9ef tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:47.697865 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-caa84f30-ff6e-46c7-bec1-fd83d430e9ef tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:47.700206 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-caa84f30-ff6e-46c7-bec1-fd83d430e9ef tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:47.701281 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-caa84f30-ff6e-46c7-bec1-fd83d430e9ef tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:47.881243 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-1a2242c4-6075-4510-b09d-3133646ab65f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:47.883458 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-1a2242c4-6075-4510-b09d-3133646ab65f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:47.909008 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1a2242c4-6075-4510-b09d-3133646ab65f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:47.910084 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1a2242c4-6075-4510-b09d-3133646ab65f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:47.911437 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1a2242c4-6075-4510-b09d-3133646ab65f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:47.912394 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1a2242c4-6075-4510-b09d-3133646ab65f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:47.926694 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-caa84f30-ff6e-46c7-bec1-fd83d430e9ef tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:47.938234 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-caa84f30-ff6e-46c7-bec1-fd83d430e9ef tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.257828 Jan 19 16:03:47.939261 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 113/218] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:47 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:48.010077 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-1a2242c4-6075-4510-b09d-3133646ab65f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 23795 microversion: 2.1 time: 0.135083 Jan 19 16:03:48.012179 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 106/219] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:03:47 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 23795 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:03:48.246681 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-67884971-db0a-4f79-ad68-adaec6e27466 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:48.247932 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-67884971-db0a-4f79-ad68-adaec6e27466 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:48.277751 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-67884971-db0a-4f79-ad68-adaec6e27466 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:48.283475 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-67884971-db0a-4f79-ad68-adaec6e27466 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:48.283475 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-67884971-db0a-4f79-ad68-adaec6e27466 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:48.283475 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-67884971-db0a-4f79-ad68-adaec6e27466 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:48.503107 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-67884971-db0a-4f79-ad68-adaec6e27466 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:48.511517 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-67884971-db0a-4f79-ad68-adaec6e27466 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1553 microversion: 2.1 time: 0.271015 Jan 19 16:03:48.512211 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 114/220] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:48 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1553 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:48.601978 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-905b1f2f-2e6a-4b71-ab0e-5b29329761fd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:48.608423 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-905b1f2f-2e6a-4b71-ab0e-5b29329761fd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:48.615693 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-905b1f2f-2e6a-4b71-ab0e-5b29329761fd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:48.616130 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-905b1f2f-2e6a-4b71-ab0e-5b29329761fd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:48.616939 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-905b1f2f-2e6a-4b71-ab0e-5b29329761fd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:48.617461 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-905b1f2f-2e6a-4b71-ab0e-5b29329761fd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:48.728640 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-905b1f2f-2e6a-4b71-ab0e-5b29329761fd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 22705 microversion: 2.20 time: 0.145591 Jan 19 16:03:48.738198 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 107/221] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:03:48 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 22705 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:03:48.972420 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f54ab89c-ffa2-459f-afb0-8e0b67d3aec4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:48.972420 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f54ab89c-ffa2-459f-afb0-8e0b67d3aec4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:48.979449 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f54ab89c-ffa2-459f-afb0-8e0b67d3aec4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:48.980116 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f54ab89c-ffa2-459f-afb0-8e0b67d3aec4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:48.981321 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f54ab89c-ffa2-459f-afb0-8e0b67d3aec4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:48.981999 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f54ab89c-ffa2-459f-afb0-8e0b67d3aec4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:49.028068 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ead7baf1-cc85-437c-83b8-faf71b007a9d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:49.029740 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-ead7baf1-cc85-437c-83b8-faf71b007a9d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:49.063342 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ead7baf1-cc85-437c-83b8-faf71b007a9d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:49.065082 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ead7baf1-cc85-437c-83b8-faf71b007a9d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:49.069279 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ead7baf1-cc85-437c-83b8-faf71b007a9d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:49.069279 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ead7baf1-cc85-437c-83b8-faf71b007a9d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:49.182063 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f54ab89c-ffa2-459f-afb0-8e0b67d3aec4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:49.194064 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-ead7baf1-cc85-437c-83b8-faf71b007a9d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 24312 microversion: 2.1 time: 0.171772 Jan 19 16:03:49.196434 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 108/222] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:03:49 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 24312 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:03:49.198317 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f54ab89c-ffa2-459f-afb0-8e0b67d3aec4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.235652 Jan 19 16:03:49.199507 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 115/223] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:48 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:49.530945 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-2ea5125d-9423-410a-b316-f8327e0cc4e5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:49.531742 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-2ea5125d-9423-410a-b316-f8327e0cc4e5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:49.539821 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2ea5125d-9423-410a-b316-f8327e0cc4e5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:49.540296 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2ea5125d-9423-410a-b316-f8327e0cc4e5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:49.541759 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2ea5125d-9423-410a-b316-f8327e0cc4e5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:49.542324 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2ea5125d-9423-410a-b316-f8327e0cc4e5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:49.658689 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-2ea5125d-9423-410a-b316-f8327e0cc4e5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:49.681354 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-2ea5125d-9423-410a-b316-f8327e0cc4e5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1511 microversion: 2.1 time: 0.153744 Jan 19 16:03:49.682698 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 109/224] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:49 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:49.746999 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-39ad73ea-a918-4c25-ada1-0d34aa08089c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:49.748462 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-39ad73ea-a918-4c25-ada1-0d34aa08089c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:49.759548 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-39ad73ea-a918-4c25-ada1-0d34aa08089c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:49.760315 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-39ad73ea-a918-4c25-ada1-0d34aa08089c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:49.761809 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-39ad73ea-a918-4c25-ada1-0d34aa08089c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:49.762325 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-39ad73ea-a918-4c25-ada1-0d34aa08089c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:49.784333 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-c9c36736-20fa-468f-9151-404cc67cb883 req-d1d9bbb0-f22f-40e9-97b9-3d9083b44844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d843b329-8449-4eb9-9d5b-a12764773e75", "name": "network-vif-deleted", "tag": "0c10b593-ffa7-45ab-aae4-22eb81766637"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:49.786065 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:03:49.786065 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:03:49.795763 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-c9c36736-20fa-468f-9151-404cc67cb883 req-d1d9bbb0-f22f-40e9-97b9-3d9083b44844 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:49.799258 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-c9c36736-20fa-468f-9151-404cc67cb883 req-d1d9bbb0-f22f-40e9-97b9-3d9083b44844 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:49.809994 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-c9c36736-20fa-468f-9151-404cc67cb883 req-d1d9bbb0-f22f-40e9-97b9-3d9083b44844 service nova] Creating event network-vif-deleted:0c10b593-ffa7-45ab-aae4-22eb81766637 for instance d843b329-8449-4eb9-9d5b-a12764773e75 on hv-cinder-82002 Jan 19 16:03:49.815574 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-c9c36736-20fa-468f-9151-404cc67cb883 req-d1d9bbb0-f22f-40e9-97b9-3d9083b44844 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034811 Jan 19 16:03:49.816536 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 110/225] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:03:49.865886 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-39ad73ea-a918-4c25-ada1-0d34aa08089c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 23216 microversion: 2.20 time: 0.122614 Jan 19 16:03:49.867425 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 116/226] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:03:49 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 23216 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:03:50.212325 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-58d4aac9-83e6-48a3-b799-99dcd01f125f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:50.212325 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-58d4aac9-83e6-48a3-b799-99dcd01f125f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:50.213828 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-58d4aac9-83e6-48a3-b799-99dcd01f125f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:50.214264 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-58d4aac9-83e6-48a3-b799-99dcd01f125f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:50.215072 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-58d4aac9-83e6-48a3-b799-99dcd01f125f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:50.215498 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-58d4aac9-83e6-48a3-b799-99dcd01f125f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:50.238617 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-761821d8-3945-46c9-b1c4-432e35fac27b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:50.239821 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-761821d8-3945-46c9-b1c4-432e35fac27b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:50.247587 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-761821d8-3945-46c9-b1c4-432e35fac27b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:50.248025 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-761821d8-3945-46c9-b1c4-432e35fac27b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:50.249002 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-761821d8-3945-46c9-b1c4-432e35fac27b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:50.249436 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-761821d8-3945-46c9-b1c4-432e35fac27b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:50.324967 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-58d4aac9-83e6-48a3-b799-99dcd01f125f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 25107 microversion: 2.1 time: 0.122563 Jan 19 16:03:50.325628 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 111/227] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:03:50 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 25107 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:03:50.485610 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-761821d8-3945-46c9-b1c4-432e35fac27b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:50.496321 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-761821d8-3945-46c9-b1c4-432e35fac27b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.262461 Jan 19 16:03:50.504969 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 117/228] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:50 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:50.710379 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-2c0fd283-057a-46f0-b5b0-ee082ee0700b tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:50.711302 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-2c0fd283-057a-46f0-b5b0-ee082ee0700b tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:50.720489 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2c0fd283-057a-46f0-b5b0-ee082ee0700b tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:50.720489 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2c0fd283-057a-46f0-b5b0-ee082ee0700b tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:50.720764 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2c0fd283-057a-46f0-b5b0-ee082ee0700b tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:50.721170 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2c0fd283-057a-46f0-b5b0-ee082ee0700b tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:50.771701 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2c0fd283-057a-46f0-b5b0-ee082ee0700b tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:50.772152 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2c0fd283-057a-46f0-b5b0-ee082ee0700b tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:50.772623 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.objects.instance [None req-2c0fd283-057a-46f0-b5b0-ee082ee0700b tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lazy-loading 'fault' on Instance uuid d843b329-8449-4eb9-9d5b-a12764773e75 {{(pid=128875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:03:50.826150 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-2c0fd283-057a-46f0-b5b0-ee082ee0700b tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae404fe9ed1466f90772a58302157d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cd7bfd1864ee1bc299e6ee813329c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:50.836653 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-2c0fd283-057a-46f0-b5b0-ee082ee0700b tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 200 len: 1350 microversion: 2.1 time: 0.130440 Jan 19 16:03:50.837505 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 112/229] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:50 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 1350 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:50.882533 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-2ebbb9c3-36e6-42cf-a686-2b825a18d46a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:50.884329 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-2ebbb9c3-36e6-42cf-a686-2b825a18d46a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:50.895756 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2ebbb9c3-36e6-42cf-a686-2b825a18d46a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:50.896538 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2ebbb9c3-36e6-42cf-a686-2b825a18d46a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:50.897930 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2ebbb9c3-36e6-42cf-a686-2b825a18d46a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:50.898682 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2ebbb9c3-36e6-42cf-a686-2b825a18d46a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:51.023039 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-2ebbb9c3-36e6-42cf-a686-2b825a18d46a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 24056 microversion: 2.20 time: 0.147947 Jan 19 16:03:51.023773 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 118/230] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:03:50 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 24056 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:03:51.340708 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-169f90b1-49ba-4eeb-a64d-eed762f5012f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:51.342467 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-169f90b1-49ba-4eeb-a64d-eed762f5012f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:51.354642 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-169f90b1-49ba-4eeb-a64d-eed762f5012f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:51.355216 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-169f90b1-49ba-4eeb-a64d-eed762f5012f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:51.356086 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-169f90b1-49ba-4eeb-a64d-eed762f5012f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:51.356515 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-169f90b1-49ba-4eeb-a64d-eed762f5012f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:51.456141 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-169f90b1-49ba-4eeb-a64d-eed762f5012f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 25542 microversion: 2.1 time: 0.120000 Jan 19 16:03:51.486749 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 113/231] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:03:51 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 25542 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:03:51.526938 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-2b1f7f84-69e3-44e3-be2c-922323d093fe tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:51.527725 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-2b1f7f84-69e3-44e3-be2c-922323d093fe tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:51.535340 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2b1f7f84-69e3-44e3-be2c-922323d093fe tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:51.535785 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2b1f7f84-69e3-44e3-be2c-922323d093fe tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:51.536733 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2b1f7f84-69e3-44e3-be2c-922323d093fe tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:51.537014 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2b1f7f84-69e3-44e3-be2c-922323d093fe tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:51.726694 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-2b1f7f84-69e3-44e3-be2c-922323d093fe tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:51.734681 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-2b1f7f84-69e3-44e3-be2c-922323d093fe tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.215183 Jan 19 16:03:51.735310 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 119/232] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:51 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:51.856645 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-af8d595d-3f3f-493d-b1e3-6ca646df317a tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:51.857367 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-af8d595d-3f3f-493d-b1e3-6ca646df317a tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:51.864616 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-af8d595d-3f3f-493d-b1e3-6ca646df317a tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:51.865065 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-af8d595d-3f3f-493d-b1e3-6ca646df317a tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:51.866009 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-af8d595d-3f3f-493d-b1e3-6ca646df317a tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:51.866449 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-af8d595d-3f3f-493d-b1e3-6ca646df317a tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:51.883682 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.wsgi [None req-af8d595d-3f3f-493d-b1e3-6ca646df317a tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] HTTP exception thrown: Instance d843b329-8449-4eb9-9d5b-a12764773e75 could not be found. Jan 19 16:03:51.884273 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-af8d595d-3f3f-493d-b1e3-6ca646df317a tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Returning 404 to user: Instance d843b329-8449-4eb9-9d5b-a12764773e75 could not be found. {{(pid=128875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:03:51.885119 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-af8d595d-3f3f-493d-b1e3-6ca646df317a tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 404 len: 111 microversion: 2.1 time: 0.033407 Jan 19 16:03:51.885657 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 114/233] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:51 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:03:52.030883 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-817f2162-c718-476a-af89-431b9762bdfd tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:52.032246 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-817f2162-c718-476a-af89-431b9762bdfd tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:52.038088 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-b09194ec-ef4d-4677-bf25-a057019a6256 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:52.039418 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-817f2162-c718-476a-af89-431b9762bdfd tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:52.040198 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-817f2162-c718-476a-af89-431b9762bdfd tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:52.041201 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-817f2162-c718-476a-af89-431b9762bdfd tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:52.041993 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-817f2162-c718-476a-af89-431b9762bdfd tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:52.045766 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-b09194ec-ef4d-4677-bf25-a057019a6256 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:52.057208 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b09194ec-ef4d-4677-bf25-a057019a6256 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:52.060238 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b09194ec-ef4d-4677-bf25-a057019a6256 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:52.071334 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.wsgi [None req-817f2162-c718-476a-af89-431b9762bdfd tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] HTTP exception thrown: Instance d843b329-8449-4eb9-9d5b-a12764773e75 could not be found. Jan 19 16:03:52.071334 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-817f2162-c718-476a-af89-431b9762bdfd tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Returning 404 to user: Instance d843b329-8449-4eb9-9d5b-a12764773e75 could not be found. {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:03:52.071626 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b09194ec-ef4d-4677-bf25-a057019a6256 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:52.072125 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-817f2162-c718-476a-af89-431b9762bdfd tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035951 Jan 19 16:03:52.072125 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 120/234] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:03:52 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:03:52.073318 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b09194ec-ef4d-4677-bf25-a057019a6256 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:52.207999 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-b09194ec-ef4d-4677-bf25-a057019a6256 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 24715 microversion: 2.20 time: 0.176226 Jan 19 16:03:52.208911 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 115/235] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:03:52 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 24715 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:03:52.496636 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-50a95bc6-eea8-441a-9e2a-3846dc5f7678 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:52.497752 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-50a95bc6-eea8-441a-9e2a-3846dc5f7678 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:52.509613 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-50a95bc6-eea8-441a-9e2a-3846dc5f7678 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:52.511275 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-50a95bc6-eea8-441a-9e2a-3846dc5f7678 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:52.511275 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-50a95bc6-eea8-441a-9e2a-3846dc5f7678 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:52.511461 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-50a95bc6-eea8-441a-9e2a-3846dc5f7678 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:52.633146 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-50a95bc6-eea8-441a-9e2a-3846dc5f7678 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 26140 microversion: 2.1 time: 0.140096 Jan 19 16:03:52.633925 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 121/236] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:03:52 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 26140 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:03:52.755612 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-1c80dfd8-9bb1-48eb-ae46-3314a0276603 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:52.756512 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-1c80dfd8-9bb1-48eb-ae46-3314a0276603 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:52.767584 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1c80dfd8-9bb1-48eb-ae46-3314a0276603 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:52.767709 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1c80dfd8-9bb1-48eb-ae46-3314a0276603 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:52.769033 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1c80dfd8-9bb1-48eb-ae46-3314a0276603 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:52.769809 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1c80dfd8-9bb1-48eb-ae46-3314a0276603 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:52.972714 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-1c80dfd8-9bb1-48eb-ae46-3314a0276603 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:52.981311 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-1c80dfd8-9bb1-48eb-ae46-3314a0276603 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.231308 Jan 19 16:03:52.982011 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 116/237] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:52 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:53.222192 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-86267d31-6405-4eb3-a852-568958798dff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:53.223927 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-86267d31-6405-4eb3-a852-568958798dff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:53.243134 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-86267d31-6405-4eb3-a852-568958798dff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:53.247975 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-86267d31-6405-4eb3-a852-568958798dff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:53.247975 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-86267d31-6405-4eb3-a852-568958798dff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:53.247975 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-86267d31-6405-4eb3-a852-568958798dff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:53.360567 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-86267d31-6405-4eb3-a852-568958798dff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 25243 microversion: 2.20 time: 0.142689 Jan 19 16:03:53.361475 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 122/238] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:03:53 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 25243 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:03:53.524417 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-33a908cb-aec7-4a57-90f1-7c788dce73f5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:53.525274 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-33a908cb-aec7-4a57-90f1-7c788dce73f5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:53.535080 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-33a908cb-aec7-4a57-90f1-7c788dce73f5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:53.535903 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-33a908cb-aec7-4a57-90f1-7c788dce73f5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:53.536780 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-33a908cb-aec7-4a57-90f1-7c788dce73f5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:53.537343 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-33a908cb-aec7-4a57-90f1-7c788dce73f5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:53.557327 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.wsgi [None req-33a908cb-aec7-4a57-90f1-7c788dce73f5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] HTTP exception thrown: Instance d843b329-8449-4eb9-9d5b-a12764773e75 could not be found. Jan 19 16:03:53.560121 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-33a908cb-aec7-4a57-90f1-7c788dce73f5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Returning 404 to user: Instance d843b329-8449-4eb9-9d5b-a12764773e75 could not be found. {{(pid=128875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:03:53.560121 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-33a908cb-aec7-4a57-90f1-7c788dce73f5 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 404 len: 111 microversion: 2.1 time: 0.041692 Jan 19 16:03:53.560121 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 117/239] 10.222.0.58 () {58 vars in 1238 bytes} [Wed Jan 19 16:03:53 2022] DELETE /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 16:03:53.568634 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-28072acd-6027-41a5-8999-78e181d6b6e7 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:53.569607 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-28072acd-6027-41a5-8999-78e181d6b6e7 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] [instance: d843b329-8449-4eb9-9d5b-a12764773e75] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:53.577229 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-28072acd-6027-41a5-8999-78e181d6b6e7 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:53.577971 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-28072acd-6027-41a5-8999-78e181d6b6e7 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:53.579809 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-28072acd-6027-41a5-8999-78e181d6b6e7 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:53.580086 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-28072acd-6027-41a5-8999-78e181d6b6e7 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:53.595922 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.wsgi [None req-28072acd-6027-41a5-8999-78e181d6b6e7 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] HTTP exception thrown: Instance d843b329-8449-4eb9-9d5b-a12764773e75 could not be found. Jan 19 16:03:53.596812 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-28072acd-6027-41a5-8999-78e181d6b6e7 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] Returning 404 to user: Instance d843b329-8449-4eb9-9d5b-a12764773e75 could not be found. {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:03:53.597659 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-28072acd-6027-41a5-8999-78e181d6b6e7 tempest-DeleteServersTestJSON-2127462681 tempest-DeleteServersTestJSON-2127462681-project] 10.222.0.58 "GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75" status: 404 len: 111 microversion: 2.1 time: 0.033839 Jan 19 16:03:53.598235 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 123/240] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:53 2022] GET /compute/v2.1/servers/d843b329-8449-4eb9-9d5b-a12764773e75 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:03:53.646043 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-1dd1d65d-9960-48ae-a4e4-6655889e4f1e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:53.647366 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-1dd1d65d-9960-48ae-a4e4-6655889e4f1e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:53.654224 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1dd1d65d-9960-48ae-a4e4-6655889e4f1e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:53.655256 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1dd1d65d-9960-48ae-a4e4-6655889e4f1e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:53.659970 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1dd1d65d-9960-48ae-a4e4-6655889e4f1e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:53.659970 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1dd1d65d-9960-48ae-a4e4-6655889e4f1e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:53.765280 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-1dd1d65d-9960-48ae-a4e4-6655889e4f1e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 26717 microversion: 2.1 time: 0.123136 Jan 19 16:03:53.766300 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 118/241] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:03:53 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 26717 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:03:53.881346 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a20eda2d-f06e-453a-8c9b-1f096c28187b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1950779005", "imageRef": "6d9c05bd-015a-44de-bd51-f744cb247e7a", "flavorRef": "452", "networks": [{"uuid": "d642b74e-4dc9-4613-8da6-c9feaf68b80d"}]}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:53.940796 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.network.neutron [None req-a20eda2d-f06e-453a-8c9b-1f096c28187b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] validate_networks() for [('d642b74e-4dc9-4613-8da6-c9feaf68b80d', None, None, None, None, None)] {{(pid=128876) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:03:54.016618 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-84d32cda-e4f6-412b-ac7f-c31d39b7d20c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:54.016618 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-84d32cda-e4f6-412b-ac7f-c31d39b7d20c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:54.021326 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-84d32cda-e4f6-412b-ac7f-c31d39b7d20c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:54.021886 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-84d32cda-e4f6-412b-ac7f-c31d39b7d20c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:54.022916 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-84d32cda-e4f6-412b-ac7f-c31d39b7d20c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:54.023626 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-84d32cda-e4f6-412b-ac7f-c31d39b7d20c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:54.222166 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-84d32cda-e4f6-412b-ac7f-c31d39b7d20c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:54.246077 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-84d32cda-e4f6-412b-ac7f-c31d39b7d20c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.245131 Jan 19 16:03:54.247584 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 119/242] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:53 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:54.372873 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-bb507147-734f-4ec2-88e5-c771c1086053 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:54.373980 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-bb507147-734f-4ec2-88e5-c771c1086053 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:54.380886 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bb507147-734f-4ec2-88e5-c771c1086053 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:54.381420 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bb507147-734f-4ec2-88e5-c771c1086053 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:54.382255 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bb507147-734f-4ec2-88e5-c771c1086053 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:54.382675 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bb507147-734f-4ec2-88e5-c771c1086053 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:54.475428 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-bb507147-734f-4ec2-88e5-c771c1086053 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 25936 microversion: 2.20 time: 0.106189 Jan 19 16:03:54.476311 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 120/243] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:03:54 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 25936 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:03:54.779315 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c323a7b5-dc90-4313-9e5b-61b7b851de59 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:54.782924 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-a20eda2d-f06e-453a-8c9b-1f096c28187b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Flavor limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:03:54.783974 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-a20eda2d-f06e-453a-8c9b-1f096c28187b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Image limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:03:54.784809 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-a20eda2d-f06e-453a-8c9b-1f096c28187b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Flavor pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:03:54.785452 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-a20eda2d-f06e-453a-8c9b-1f096c28187b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Image pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:03:54.786081 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-a20eda2d-f06e-453a-8c9b-1f096c28187b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:03:54.790370 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c323a7b5-dc90-4313-9e5b-61b7b851de59 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:54.807077 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c323a7b5-dc90-4313-9e5b-61b7b851de59 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:54.807655 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a20eda2d-f06e-453a-8c9b-1f096c28187b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:54.808421 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a20eda2d-f06e-453a-8c9b-1f096c28187b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:54.809957 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c323a7b5-dc90-4313-9e5b-61b7b851de59 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:54.810433 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a20eda2d-f06e-453a-8c9b-1f096c28187b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:54.811991 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a20eda2d-f06e-453a-8c9b-1f096c28187b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:54.812706 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c323a7b5-dc90-4313-9e5b-61b7b851de59 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:54.814916 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c323a7b5-dc90-4313-9e5b-61b7b851de59 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:54.850062 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-a20eda2d-f06e-453a-8c9b-1f096c28187b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Getting quotas for project a7e40e4efd974d37820bb6724978d22f. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:03:54.856073 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-a20eda2d-f06e-453a-8c9b-1f096c28187b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Getting quotas for user 3f7ace876fa34fe688d055a4a5fb1fdb and project a7e40e4efd974d37820bb6724978d22f. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:03:54.874990 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a20eda2d-f06e-453a-8c9b-1f096c28187b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Going to run 1 instances... {{(pid=128876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:03:54.878022 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a20eda2d-f06e-453a-8c9b-1f096c28187b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: 35008211-e55b-4ef3-99d2-36769725e7d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6d9c05bd-015a-44de-bd51-f744cb247e7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:03:54.931994 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c323a7b5-dc90-4313-9e5b-61b7b851de59 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 27136 microversion: 2.1 time: 0.156526 Jan 19 16:03:54.933645 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 121/244] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:03:54 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 27136 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:03:55.066416 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a20eda2d-f06e-453a-8c9b-1f096c28187b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.189248 Jan 19 16:03:55.067538 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 124/245] 10.222.0.58 () {60 vars in 1146 bytes} [Wed Jan 19 16:03:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:03:55.082508 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d0fc1e01-6544-4672-b5eb-232528a36681 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:55.092769 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d0fc1e01-6544-4672-b5eb-232528a36681 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: 35008211-e55b-4ef3-99d2-36769725e7d7] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:55.152477 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d0fc1e01-6544-4672-b5eb-232528a36681 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:55.160590 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d0fc1e01-6544-4672-b5eb-232528a36681 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7" status: 200 len: 1218 microversion: 2.1 time: 0.083202 Jan 19 16:03:55.171689 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 122/246] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:55 2022] GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:55.268086 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-7e25b22b-a889-4275-9bf0-eff6bab955db tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:55.268724 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-7e25b22b-a889-4275-9bf0-eff6bab955db tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:55.276522 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7e25b22b-a889-4275-9bf0-eff6bab955db tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:55.276968 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7e25b22b-a889-4275-9bf0-eff6bab955db tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:55.277814 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7e25b22b-a889-4275-9bf0-eff6bab955db tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:55.278245 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7e25b22b-a889-4275-9bf0-eff6bab955db tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:55.479967 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-7e25b22b-a889-4275-9bf0-eff6bab955db tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:55.491332 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-da3b1c88-8a09-46c4-a8a3-02cb04455f34 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:55.495175 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-da3b1c88-8a09-46c4-a8a3-02cb04455f34 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:55.501579 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-7e25b22b-a889-4275-9bf0-eff6bab955db tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.237273 Jan 19 16:03:55.502394 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 125/247] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:55 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:55.511684 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-da3b1c88-8a09-46c4-a8a3-02cb04455f34 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:55.512560 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-da3b1c88-8a09-46c4-a8a3-02cb04455f34 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:55.513864 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-da3b1c88-8a09-46c4-a8a3-02cb04455f34 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:55.514492 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-da3b1c88-8a09-46c4-a8a3-02cb04455f34 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:55.640859 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-da3b1c88-8a09-46c4-a8a3-02cb04455f34 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 26568 microversion: 2.20 time: 0.153624 Jan 19 16:03:55.643239 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 123/248] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:03:55 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 26568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:03:55.954004 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-fe500bcd-5be5-4634-a35f-562bfa26784d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:55.956455 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-fe500bcd-5be5-4634-a35f-562bfa26784d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:55.964606 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fe500bcd-5be5-4634-a35f-562bfa26784d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:55.965039 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fe500bcd-5be5-4634-a35f-562bfa26784d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:55.965839 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fe500bcd-5be5-4634-a35f-562bfa26784d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:55.966271 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fe500bcd-5be5-4634-a35f-562bfa26784d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:56.090273 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-fe500bcd-5be5-4634-a35f-562bfa26784d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 27588 microversion: 2.1 time: 0.143366 Jan 19 16:03:56.092617 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 126/249] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:03:55 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 27588 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:03:56.184606 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d05daffe-c464-467c-9502-e8e3edb62de2 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:56.188091 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d05daffe-c464-467c-9502-e8e3edb62de2 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: 35008211-e55b-4ef3-99d2-36769725e7d7] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:56.255551 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d05daffe-c464-467c-9502-e8e3edb62de2 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:56.266774 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d05daffe-c464-467c-9502-e8e3edb62de2 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7" status: 200 len: 1218 microversion: 2.1 time: 0.091163 Jan 19 16:03:56.268320 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 124/250] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:56 2022] GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:56.545328 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-cf0772f5-7776-4d82-b4b3-a9bb0a0e1b2e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:56.546421 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-cf0772f5-7776-4d82-b4b3-a9bb0a0e1b2e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:56.556756 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cf0772f5-7776-4d82-b4b3-a9bb0a0e1b2e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:56.557392 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cf0772f5-7776-4d82-b4b3-a9bb0a0e1b2e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:56.558489 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cf0772f5-7776-4d82-b4b3-a9bb0a0e1b2e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:56.559063 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cf0772f5-7776-4d82-b4b3-a9bb0a0e1b2e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:56.653497 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e8972906-58a3-4cfb-82ad-9680b7a76b43 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:56.654404 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-e8972906-58a3-4cfb-82ad-9680b7a76b43 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:56.661144 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e8972906-58a3-4cfb-82ad-9680b7a76b43 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:56.661588 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e8972906-58a3-4cfb-82ad-9680b7a76b43 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:56.662389 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e8972906-58a3-4cfb-82ad-9680b7a76b43 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:56.662764 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e8972906-58a3-4cfb-82ad-9680b7a76b43 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:56.729122 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-cf0772f5-7776-4d82-b4b3-a9bb0a0e1b2e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:56.743211 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-cf0772f5-7776-4d82-b4b3-a9bb0a0e1b2e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.202438 Jan 19 16:03:56.744438 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 127/251] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:56 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:56.779034 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e8972906-58a3-4cfb-82ad-9680b7a76b43 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 27292 microversion: 2.20 time: 0.129087 Jan 19 16:03:56.781222 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 125/252] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:03:56 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 27292 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:03:57.103307 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-7bcfeb85-2db6-4a6c-8980-36edc8b5ce76 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:57.104441 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-7bcfeb85-2db6-4a6c-8980-36edc8b5ce76 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:57.111684 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7bcfeb85-2db6-4a6c-8980-36edc8b5ce76 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:57.112187 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7bcfeb85-2db6-4a6c-8980-36edc8b5ce76 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:57.112942 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7bcfeb85-2db6-4a6c-8980-36edc8b5ce76 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:57.113373 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7bcfeb85-2db6-4a6c-8980-36edc8b5ce76 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:57.242675 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-7bcfeb85-2db6-4a6c-8980-36edc8b5ce76 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 27710 microversion: 2.1 time: 0.143364 Jan 19 16:03:57.243538 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 128/253] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:03:57 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 27710 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:03:57.303505 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-2f4c4796-f15e-408e-a465-896d5e705edb tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:57.304541 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-2f4c4796-f15e-408e-a465-896d5e705edb tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: 35008211-e55b-4ef3-99d2-36769725e7d7] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:57.316318 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2f4c4796-f15e-408e-a465-896d5e705edb tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:57.317150 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2f4c4796-f15e-408e-a465-896d5e705edb tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:57.318475 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2f4c4796-f15e-408e-a465-896d5e705edb tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:57.319213 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2f4c4796-f15e-408e-a465-896d5e705edb tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:57.442351 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-2f4c4796-f15e-408e-a465-896d5e705edb tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:57.450745 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-2f4c4796-f15e-408e-a465-896d5e705edb tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7" status: 200 len: 1270 microversion: 2.1 time: 0.155179 Jan 19 16:03:57.451369 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 126/254] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:57 2022] GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7 => generated 1270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:57.764609 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-7232e58a-1046-4afc-9e72-bb9e9a383a70 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:57.766019 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-7232e58a-1046-4afc-9e72-bb9e9a383a70 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:57.781876 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7232e58a-1046-4afc-9e72-bb9e9a383a70 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:57.782849 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7232e58a-1046-4afc-9e72-bb9e9a383a70 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:57.783905 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7232e58a-1046-4afc-9e72-bb9e9a383a70 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:57.784843 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7232e58a-1046-4afc-9e72-bb9e9a383a70 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:57.911112 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-6fc719f2-f7af-4fe7-8f9a-411b8571bc25 tempest-VolumesGetTestJSON-1222740846 tempest-VolumesGetTestJSON-1222740846-project] Action: 'create', calling method: .version_select at 0x7feff537fa60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-563637358", "metadata": {"Type": "work"}}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:58.010125 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-7232e58a-1046-4afc-9e72-bb9e9a383a70 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:58.019044 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-7232e58a-1046-4afc-9e72-bb9e9a383a70 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.260153 Jan 19 16:03:58.020287 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 127/255] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:57 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:58.026404 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-a30c3466-bcf0-4f67-8836-2c25910ca559 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:58.028086 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-a30c3466-bcf0-4f67-8836-2c25910ca559 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:58.038220 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a30c3466-bcf0-4f67-8836-2c25910ca559 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:58.039152 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a30c3466-bcf0-4f67-8836-2c25910ca559 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:58.040291 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a30c3466-bcf0-4f67-8836-2c25910ca559 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:58.040782 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a30c3466-bcf0-4f67-8836-2c25910ca559 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:58.150281 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-a30c3466-bcf0-4f67-8836-2c25910ca559 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 27678 microversion: 2.20 time: 0.128222 Jan 19 16:03:58.156342 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 128/256] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:03:58 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 27678 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:03:58.261748 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-75fb660f-49ef-47cc-b2be-02e3a6390ac4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:58.263731 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-75fb660f-49ef-47cc-b2be-02e3a6390ac4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:58.276739 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-75fb660f-49ef-47cc-b2be-02e3a6390ac4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:58.277761 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-75fb660f-49ef-47cc-b2be-02e3a6390ac4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:58.279452 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-75fb660f-49ef-47cc-b2be-02e3a6390ac4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:58.291182 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-75fb660f-49ef-47cc-b2be-02e3a6390ac4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:58.426175 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-75fb660f-49ef-47cc-b2be-02e3a6390ac4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28016 microversion: 2.1 time: 0.171981 Jan 19 16:03:58.429498 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 129/257] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:03:58 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28016 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:03:58.482544 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-5b473d81-25e5-4d5d-9ea4-026d367755e7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:58.483893 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-5b473d81-25e5-4d5d-9ea4-026d367755e7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: 35008211-e55b-4ef3-99d2-36769725e7d7] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:58.495713 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5b473d81-25e5-4d5d-9ea4-026d367755e7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:58.496457 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5b473d81-25e5-4d5d-9ea4-026d367755e7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:58.498438 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5b473d81-25e5-4d5d-9ea4-026d367755e7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:58.499562 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5b473d81-25e5-4d5d-9ea4-026d367755e7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:58.665615 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-5b473d81-25e5-4d5d-9ea4-026d367755e7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:58.680372 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-5b473d81-25e5-4d5d-9ea4-026d367755e7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7" status: 200 len: 1278 microversion: 2.1 time: 0.203504 Jan 19 16:03:58.693122 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 130/258] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:58 2022] GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7 => generated 1278 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:03:59.030082 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-6fc719f2-f7af-4fe7-8f9a-411b8571bc25 tempest-VolumesGetTestJSON-1222740846 tempest-VolumesGetTestJSON-1222740846-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.552842 Jan 19 16:03:59.035206 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 129/259] 10.222.0.58 () {60 vars in 1155 bytes} [Wed Jan 19 16:03:57 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1557 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jan 19 16:03:59.047565 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-a9c247b7-6a97-43f9-b1cd-61f3121b2b4c tempest-VolumesGetTestJSON-1222740846 tempest-VolumesGetTestJSON-1222740846-project] Calling method '.version_select at 0x7feff55874c0>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:59.052243 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-7aff0d5e-484d-4e9d-823f-6d243098b90b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:59.053478 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-7aff0d5e-484d-4e9d-823f-6d243098b90b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:59.068105 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7aff0d5e-484d-4e9d-823f-6d243098b90b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:59.068872 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7aff0d5e-484d-4e9d-823f-6d243098b90b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:59.071888 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7aff0d5e-484d-4e9d-823f-6d243098b90b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:59.072652 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7aff0d5e-484d-4e9d-823f-6d243098b90b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:59.264703 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-a9c247b7-6a97-43f9-b1cd-61f3121b2b4c tempest-VolumesGetTestJSON-1222740846 tempest-VolumesGetTestJSON-1222740846-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/e0f85a86-baaa-4286-8884-4d5a44115626" status: 200 len: 352 microversion: 2.1 time: 0.222713 Jan 19 16:03:59.271753 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 131/260] 10.222.0.58 () {58 vars in 1244 bytes} [Wed Jan 19 16:03:59 2022] GET /compute/v2.1/os-volumes/e0f85a86-baaa-4286-8884-4d5a44115626 => generated 352 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:03:59.272592 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-21eb395d-b474-4960-b843-3c8d091ed415 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:59.274236 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-21eb395d-b474-4960-b843-3c8d091ed415 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:59.297759 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-21eb395d-b474-4960-b843-3c8d091ed415 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:59.298622 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-21eb395d-b474-4960-b843-3c8d091ed415 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:59.305919 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-21eb395d-b474-4960-b843-3c8d091ed415 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:59.306520 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-21eb395d-b474-4960-b843-3c8d091ed415 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:59.354046 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-7aff0d5e-484d-4e9d-823f-6d243098b90b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:59.363559 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-7aff0d5e-484d-4e9d-823f-6d243098b90b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.319732 Jan 19 16:03:59.364692 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 130/261] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:59 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:03:59.405090 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-21eb395d-b474-4960-b843-3c8d091ed415 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 27894 microversion: 2.20 time: 0.136039 Jan 19 16:03:59.409151 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 132/262] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:03:59 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 27894 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:03:59.441929 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b6324d86-25a9-44e4-a762-3f22fca6f43c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:03:59.442816 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b6324d86-25a9-44e4-a762-3f22fca6f43c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:59.448993 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b6324d86-25a9-44e4-a762-3f22fca6f43c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:59.449390 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b6324d86-25a9-44e4-a762-3f22fca6f43c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:59.450178 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b6324d86-25a9-44e4-a762-3f22fca6f43c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:59.450606 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b6324d86-25a9-44e4-a762-3f22fca6f43c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:59.542645 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b6324d86-25a9-44e4-a762-3f22fca6f43c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28133 microversion: 2.1 time: 0.104579 Jan 19 16:03:59.544341 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 131/263] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:03:59 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28133 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:03:59.703194 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-57c87d5c-509b-40fb-82db-ee78a4671814 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:03:59.703952 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-57c87d5c-509b-40fb-82db-ee78a4671814 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: 35008211-e55b-4ef3-99d2-36769725e7d7] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:03:59.724731 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-57c87d5c-509b-40fb-82db-ee78a4671814 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:59.724731 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-57c87d5c-509b-40fb-82db-ee78a4671814 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:59.725422 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-57c87d5c-509b-40fb-82db-ee78a4671814 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:03:59.726108 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-57c87d5c-509b-40fb-82db-ee78a4671814 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:03:59.839036 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-57c87d5c-509b-40fb-82db-ee78a4671814 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:03:59.855244 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-57c87d5c-509b-40fb-82db-ee78a4671814 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7" status: 200 len: 1276 microversion: 2.1 time: 0.158033 Jan 19 16:03:59.866000 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 133/264] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:03:59 2022] GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7 => generated 1276 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:00.284711 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e769fc1e-ebb3-4ad5-acd0-40e27203901f tempest-VolumesGetTestJSON-1222740846 tempest-VolumesGetTestJSON-1222740846-project] Calling method '.version_select at 0x7feff537fc10>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:00.388474 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-72b30684-b8c3-46d1-8da9-fb6e291b0f45 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:00.390580 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-72b30684-b8c3-46d1-8da9-fb6e291b0f45 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:00.397265 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e769fc1e-ebb3-4ad5-acd0-40e27203901f tempest-VolumesGetTestJSON-1222740846 tempest-VolumesGetTestJSON-1222740846-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/e0f85a86-baaa-4286-8884-4d5a44115626" status: 200 len: 353 microversion: 2.1 time: 0.121124 Jan 19 16:04:00.405428 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 132/265] 10.222.0.58 () {58 vars in 1244 bytes} [Wed Jan 19 16:04:00 2022] GET /compute/v2.1/os-volumes/e0f85a86-baaa-4286-8884-4d5a44115626 => generated 353 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:04:00.414122 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-7688178e-353f-453d-bba5-54228f93ccbe tempest-VolumesGetTestJSON-1222740846 tempest-VolumesGetTestJSON-1222740846-project] Calling method '.version_select at 0x7feff53c24c0>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:00.418873 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-72b30684-b8c3-46d1-8da9-fb6e291b0f45 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:00.419764 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-72b30684-b8c3-46d1-8da9-fb6e291b0f45 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:00.425655 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-72b30684-b8c3-46d1-8da9-fb6e291b0f45 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:00.426496 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-72b30684-b8c3-46d1-8da9-fb6e291b0f45 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:00.486192 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-7688178e-353f-453d-bba5-54228f93ccbe tempest-VolumesGetTestJSON-1222740846 tempest-VolumesGetTestJSON-1222740846-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/e0f85a86-baaa-4286-8884-4d5a44115626" status: 200 len: 353 microversion: 2.1 time: 0.079207 Jan 19 16:04:00.498369 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 133/266] 10.222.0.58 () {58 vars in 1244 bytes} [Wed Jan 19 16:04:00 2022] GET /compute/v2.1/os-volumes/e0f85a86-baaa-4286-8884-4d5a44115626 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:04:00.511139 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-1809993f-6605-4519-beff-7acd44a9ea07 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:00.512817 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-1809993f-6605-4519-beff-7acd44a9ea07 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:00.523629 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1809993f-6605-4519-beff-7acd44a9ea07 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:00.527112 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1809993f-6605-4519-beff-7acd44a9ea07 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:00.528954 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1809993f-6605-4519-beff-7acd44a9ea07 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:00.529730 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1809993f-6605-4519-beff-7acd44a9ea07 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:00.634346 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-1809993f-6605-4519-beff-7acd44a9ea07 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28205 microversion: 2.20 time: 0.127927 Jan 19 16:04:00.634346 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 134/267] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:00 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28205 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:00.636161 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d0bf6f6c-f65a-49d4-991e-2ef75b47adfe tempest-VolumesGetTestJSON-1222740846 tempest-VolumesGetTestJSON-1222740846-project] Calling method '.version_select at 0x7feff53c25e0>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:00.732153 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-72b30684-b8c3-46d1-8da9-fb6e291b0f45 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:00.747179 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-72b30684-b8c3-46d1-8da9-fb6e291b0f45 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.366624 Jan 19 16:04:00.747771 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 134/268] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:00 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:00.759735 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-21e0fdad-7af5-4512-a3a2-e33040bc4bae tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:00.760893 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-21e0fdad-7af5-4512-a3a2-e33040bc4bae tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:00.771410 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-21e0fdad-7af5-4512-a3a2-e33040bc4bae tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:00.772056 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-21e0fdad-7af5-4512-a3a2-e33040bc4bae tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:00.773070 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-21e0fdad-7af5-4512-a3a2-e33040bc4bae tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:00.773827 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-21e0fdad-7af5-4512-a3a2-e33040bc4bae tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:00.860523 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-21e0fdad-7af5-4512-a3a2-e33040bc4bae tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28133 microversion: 2.1 time: 0.111255 Jan 19 16:04:00.861388 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 135/269] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:00 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28133 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:00.912061 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6813135e-17f8-469e-8fbc-62341e723782 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:00.913694 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-6813135e-17f8-469e-8fbc-62341e723782 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: 35008211-e55b-4ef3-99d2-36769725e7d7] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:00.940468 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6813135e-17f8-469e-8fbc-62341e723782 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:00.941007 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6813135e-17f8-469e-8fbc-62341e723782 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:00.942921 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6813135e-17f8-469e-8fbc-62341e723782 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:00.944121 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6813135e-17f8-469e-8fbc-62341e723782 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:00.967299 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-d0bf6f6c-f65a-49d4-991e-2ef75b47adfe tempest-VolumesGetTestJSON-1222740846 tempest-VolumesGetTestJSON-1222740846-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/e0f85a86-baaa-4286-8884-4d5a44115626" status: 202 len: 0 microversion: 2.1 time: 0.325053 Jan 19 16:04:00.978944 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 135/270] 10.222.0.58 () {58 vars in 1247 bytes} [Wed Jan 19 16:04:00 2022] DELETE /compute/v2.1/os-volumes/e0f85a86-baaa-4286-8884-4d5a44115626 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:01.021350 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f054efdf-1a41-41b4-995d-9638648f6589 tempest-VolumesGetTestJSON-1222740846 tempest-VolumesGetTestJSON-1222740846-project] Calling method '.version_select at 0x7feff5463c10>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:01.106209 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f054efdf-1a41-41b4-995d-9638648f6589 tempest-VolumesGetTestJSON-1222740846 tempest-VolumesGetTestJSON-1222740846-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/e0f85a86-baaa-4286-8884-4d5a44115626" status: 200 len: 352 microversion: 2.1 time: 0.116133 Jan 19 16:04:01.107755 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 136/271] 10.222.0.58 () {58 vars in 1244 bytes} [Wed Jan 19 16:04:00 2022] GET /compute/v2.1/os-volumes/e0f85a86-baaa-4286-8884-4d5a44115626 => generated 352 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:04:01.351497 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6813135e-17f8-469e-8fbc-62341e723782 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:01.385696 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6813135e-17f8-469e-8fbc-62341e723782 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7" status: 200 len: 1318 microversion: 2.1 time: 0.483019 Jan 19 16:04:01.388847 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 136/272] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:00 2022] GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7 => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:01.611426 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-83917f14-8427-46ea-a1e7-0e676eedee70 req-53308c73-f51e-470a-bdcc-0df80aa19981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35008211-e55b-4ef3-99d2-36769725e7d7", "tag": "558fd963-51da-4461-b393-d0f82483fa47"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:01.614327 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:04:01.614327 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:04:01.630104 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-83917f14-8427-46ea-a1e7-0e676eedee70 req-53308c73-f51e-470a-bdcc-0df80aa19981 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:01.638798 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-83917f14-8427-46ea-a1e7-0e676eedee70 req-53308c73-f51e-470a-bdcc-0df80aa19981 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:01.645468 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-5e9a13a7-e892-4b34-9be1-61e7a2472de2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:01.646330 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-5e9a13a7-e892-4b34-9be1-61e7a2472de2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:01.652057 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-83917f14-8427-46ea-a1e7-0e676eedee70 req-53308c73-f51e-470a-bdcc-0df80aa19981 service nova] Creating event network-changed:558fd963-51da-4461-b393-d0f82483fa47 for instance 35008211-e55b-4ef3-99d2-36769725e7d7 on hv-cinder-82002 Jan 19 16:04:01.654338 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5e9a13a7-e892-4b34-9be1-61e7a2472de2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:01.655953 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5e9a13a7-e892-4b34-9be1-61e7a2472de2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:01.655953 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5e9a13a7-e892-4b34-9be1-61e7a2472de2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:01.656136 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5e9a13a7-e892-4b34-9be1-61e7a2472de2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:01.660073 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-83917f14-8427-46ea-a1e7-0e676eedee70 req-53308c73-f51e-470a-bdcc-0df80aa19981 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059555 Jan 19 16:04:01.660912 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 137/273] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:04:01.742471 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-5e9a13a7-e892-4b34-9be1-61e7a2472de2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28205 microversion: 2.20 time: 0.103709 Jan 19 16:04:01.749056 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 137/274] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:01 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28205 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:01.768733 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-26cb8d51-3b09-43f1-9eb7-89b7ce1887a7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:01.769597 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-26cb8d51-3b09-43f1-9eb7-89b7ce1887a7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:01.790101 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-26cb8d51-3b09-43f1-9eb7-89b7ce1887a7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:01.791836 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-26cb8d51-3b09-43f1-9eb7-89b7ce1887a7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:01.793072 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-26cb8d51-3b09-43f1-9eb7-89b7ce1887a7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:01.793798 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-26cb8d51-3b09-43f1-9eb7-89b7ce1887a7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:01.887787 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-cdfd3a11-7cbf-4ec2-918a-59e104a52fbf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:01.890308 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-cdfd3a11-7cbf-4ec2-918a-59e104a52fbf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:01.904278 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cdfd3a11-7cbf-4ec2-918a-59e104a52fbf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:01.905361 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cdfd3a11-7cbf-4ec2-918a-59e104a52fbf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:01.907066 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cdfd3a11-7cbf-4ec2-918a-59e104a52fbf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:01.909640 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cdfd3a11-7cbf-4ec2-918a-59e104a52fbf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:02.030197 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-cdfd3a11-7cbf-4ec2-918a-59e104a52fbf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28133 microversion: 2.1 time: 0.151882 Jan 19 16:04:02.035407 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 138/275] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:01 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28133 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:02.123029 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d7fb2a3d-df4d-40fe-aba9-2df9b621e62a tempest-VolumesGetTestJSON-1222740846 tempest-VolumesGetTestJSON-1222740846-project] Calling method '.version_select at 0x7feff54cd4c0>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:02.172835 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.wsgi [None req-d7fb2a3d-df4d-40fe-aba9-2df9b621e62a tempest-VolumesGetTestJSON-1222740846 tempest-VolumesGetTestJSON-1222740846-project] HTTP exception thrown: Volume e0f85a86-baaa-4286-8884-4d5a44115626 could not be found. Jan 19 16:04:02.172835 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d7fb2a3d-df4d-40fe-aba9-2df9b621e62a tempest-VolumesGetTestJSON-1222740846 tempest-VolumesGetTestJSON-1222740846-project] Returning 404 to user: Volume e0f85a86-baaa-4286-8884-4d5a44115626 could not be found. {{(pid=128875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:04:02.172835 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d7fb2a3d-df4d-40fe-aba9-2df9b621e62a tempest-VolumesGetTestJSON-1222740846 tempest-VolumesGetTestJSON-1222740846-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/e0f85a86-baaa-4286-8884-4d5a44115626" status: 404 len: 109 microversion: 2.1 time: 0.055259 Jan 19 16:04:02.173460 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 139/276] 10.222.0.58 () {58 vars in 1244 bytes} [Wed Jan 19 16:04:02 2022] GET /compute/v2.1/os-volumes/e0f85a86-baaa-4286-8884-4d5a44115626 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:04:02.198496 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-26cb8d51-3b09-43f1-9eb7-89b7ce1887a7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:02.208098 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-26cb8d51-3b09-43f1-9eb7-89b7ce1887a7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.446754 Jan 19 16:04:02.208709 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 138/277] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:01 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:02.407203 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f68fcc21-45a7-41ad-a01f-d97b30fd1e65 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:02.408696 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-f68fcc21-45a7-41ad-a01f-d97b30fd1e65 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: 35008211-e55b-4ef3-99d2-36769725e7d7] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:02.416261 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f68fcc21-45a7-41ad-a01f-d97b30fd1e65 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:02.416719 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f68fcc21-45a7-41ad-a01f-d97b30fd1e65 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:02.417602 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f68fcc21-45a7-41ad-a01f-d97b30fd1e65 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:02.418036 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f68fcc21-45a7-41ad-a01f-d97b30fd1e65 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:02.755880 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3f068c8b-2b57-4cd1-938e-bb8712e9e171 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:02.757762 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3f068c8b-2b57-4cd1-938e-bb8712e9e171 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:02.771015 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3f068c8b-2b57-4cd1-938e-bb8712e9e171 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:02.771743 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3f068c8b-2b57-4cd1-938e-bb8712e9e171 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:02.772560 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-f68fcc21-45a7-41ad-a01f-d97b30fd1e65 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:02.773453 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3f068c8b-2b57-4cd1-938e-bb8712e9e171 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:02.775493 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3f068c8b-2b57-4cd1-938e-bb8712e9e171 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:02.786802 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f68fcc21-45a7-41ad-a01f-d97b30fd1e65 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7" status: 200 len: 1318 microversion: 2.1 time: 0.384945 Jan 19 16:04:02.788921 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 140/278] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:02 2022] GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7 => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:02.875030 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3f068c8b-2b57-4cd1-938e-bb8712e9e171 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28205 microversion: 2.20 time: 0.122755 Jan 19 16:04:02.876256 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 139/279] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:02 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28205 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:03.062202 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-9c7f7720-fbe2-4b21-a92b-b8de952dc973 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:03.062202 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-9c7f7720-fbe2-4b21-a92b-b8de952dc973 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:03.074106 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9c7f7720-fbe2-4b21-a92b-b8de952dc973 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:03.076220 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9c7f7720-fbe2-4b21-a92b-b8de952dc973 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:03.077376 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9c7f7720-fbe2-4b21-a92b-b8de952dc973 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:03.077831 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9c7f7720-fbe2-4b21-a92b-b8de952dc973 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:03.237438 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-15a3d0eb-ddf9-415f-a124-0b3d2ed51d08 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:03.238182 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-15a3d0eb-ddf9-415f-a124-0b3d2ed51d08 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:03.250266 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-15a3d0eb-ddf9-415f-a124-0b3d2ed51d08 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:03.256430 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-15a3d0eb-ddf9-415f-a124-0b3d2ed51d08 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:03.257538 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-15a3d0eb-ddf9-415f-a124-0b3d2ed51d08 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:03.257985 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-15a3d0eb-ddf9-415f-a124-0b3d2ed51d08 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:03.369162 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-9c7f7720-fbe2-4b21-a92b-b8de952dc973 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28133 microversion: 2.1 time: 0.324717 Jan 19 16:04:03.371828 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 141/280] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:03 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28133 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:03.520933 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-15a3d0eb-ddf9-415f-a124-0b3d2ed51d08 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:03.530955 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-15a3d0eb-ddf9-415f-a124-0b3d2ed51d08 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.298374 Jan 19 16:04:03.535799 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 140/281] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:03 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:03.809988 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ba212f44-7821-4e88-9a5e-d3a5ec683401 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:03.817406 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-ba212f44-7821-4e88-9a5e-d3a5ec683401 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: 35008211-e55b-4ef3-99d2-36769725e7d7] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:03.819650 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ba212f44-7821-4e88-9a5e-d3a5ec683401 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:03.820321 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ba212f44-7821-4e88-9a5e-d3a5ec683401 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:03.821291 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ba212f44-7821-4e88-9a5e-d3a5ec683401 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:03.821896 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ba212f44-7821-4e88-9a5e-d3a5ec683401 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:03.888608 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-fe36bda6-ee19-452a-aef4-4d4caeca2912 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:03.889900 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-fe36bda6-ee19-452a-aef4-4d4caeca2912 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:03.897182 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fe36bda6-ee19-452a-aef4-4d4caeca2912 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:03.898138 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fe36bda6-ee19-452a-aef4-4d4caeca2912 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:03.899018 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fe36bda6-ee19-452a-aef4-4d4caeca2912 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:03.899605 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fe36bda6-ee19-452a-aef4-4d4caeca2912 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:04.068135 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ba212f44-7821-4e88-9a5e-d3a5ec683401 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:04.072909 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-fe36bda6-ee19-452a-aef4-4d4caeca2912 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28205 microversion: 2.20 time: 0.189686 Jan 19 16:04:04.073949 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 141/282] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:03 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28205 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:04.084428 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-ba212f44-7821-4e88-9a5e-d3a5ec683401 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7" status: 200 len: 1318 microversion: 2.1 time: 0.282013 Jan 19 16:04:04.094711 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 142/283] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:03 2022] GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:04.388910 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-2845dd75-d075-4ea6-8412-24a8c15c8d6b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:04.390740 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-2845dd75-d075-4ea6-8412-24a8c15c8d6b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:04.405004 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2845dd75-d075-4ea6-8412-24a8c15c8d6b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:04.405947 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2845dd75-d075-4ea6-8412-24a8c15c8d6b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:04.407651 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2845dd75-d075-4ea6-8412-24a8c15c8d6b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:04.408506 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2845dd75-d075-4ea6-8412-24a8c15c8d6b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:04.509614 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-2845dd75-d075-4ea6-8412-24a8c15c8d6b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28133 microversion: 2.1 time: 0.127383 Jan 19 16:04:04.512099 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 142/284] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:04 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28133 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:04.588501 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-73d83f11-7616-439c-bf77-dd96df675153 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:04.593079 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-73d83f11-7616-439c-bf77-dd96df675153 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:04.618502 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-73d83f11-7616-439c-bf77-dd96df675153 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:04.618997 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-73d83f11-7616-439c-bf77-dd96df675153 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:04.620898 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-73d83f11-7616-439c-bf77-dd96df675153 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:04.622847 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-73d83f11-7616-439c-bf77-dd96df675153 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:04.912044 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-73d83f11-7616-439c-bf77-dd96df675153 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:04.930189 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-73d83f11-7616-439c-bf77-dd96df675153 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.363932 Jan 19 16:04:04.932621 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 143/285] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:04 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:05.092549 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a0a0ac0a-a921-4033-8407-8a2fb10c0705 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:05.099072 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a0a0ac0a-a921-4033-8407-8a2fb10c0705 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:05.102116 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d114cb1a-0927-4a2a-a7c6-d8c1859b845a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:05.102717 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d114cb1a-0927-4a2a-a7c6-d8c1859b845a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: 35008211-e55b-4ef3-99d2-36769725e7d7] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:05.129087 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d114cb1a-0927-4a2a-a7c6-d8c1859b845a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:05.129552 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d114cb1a-0927-4a2a-a7c6-d8c1859b845a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:05.130414 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d114cb1a-0927-4a2a-a7c6-d8c1859b845a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:05.130862 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d114cb1a-0927-4a2a-a7c6-d8c1859b845a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:05.132464 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a0a0ac0a-a921-4033-8407-8a2fb10c0705 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:05.137989 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a0a0ac0a-a921-4033-8407-8a2fb10c0705 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:05.147117 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a0a0ac0a-a921-4033-8407-8a2fb10c0705 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:05.149562 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a0a0ac0a-a921-4033-8407-8a2fb10c0705 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:05.443254 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a0a0ac0a-a921-4033-8407-8a2fb10c0705 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28205 microversion: 2.20 time: 0.358728 Jan 19 16:04:05.445170 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 143/286] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:05 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28205 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:05.522653 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b32f3a5d-3485-4dc2-9b08-fdfd9ae707cb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:05.529276 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b32f3a5d-3485-4dc2-9b08-fdfd9ae707cb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:05.536477 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b32f3a5d-3485-4dc2-9b08-fdfd9ae707cb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:05.538673 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b32f3a5d-3485-4dc2-9b08-fdfd9ae707cb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:05.543957 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b32f3a5d-3485-4dc2-9b08-fdfd9ae707cb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:05.545584 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b32f3a5d-3485-4dc2-9b08-fdfd9ae707cb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:05.662075 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b32f3a5d-3485-4dc2-9b08-fdfd9ae707cb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28133 microversion: 2.1 time: 0.139713 Jan 19 16:04:05.667625 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 144/287] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:05 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28133 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:05.955472 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f12de8e1-a74b-495b-ab07-38358d7b94e1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:05.956294 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f12de8e1-a74b-495b-ab07-38358d7b94e1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:05.962550 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d114cb1a-0927-4a2a-a7c6-d8c1859b845a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:05.978824 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f12de8e1-a74b-495b-ab07-38358d7b94e1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:05.979534 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f12de8e1-a74b-495b-ab07-38358d7b94e1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:05.981362 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f12de8e1-a74b-495b-ab07-38358d7b94e1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:05.982694 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d114cb1a-0927-4a2a-a7c6-d8c1859b845a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7" status: 200 len: 1318 microversion: 2.1 time: 0.884007 Jan 19 16:04:05.983437 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f12de8e1-a74b-495b-ab07-38358d7b94e1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:05.996815 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 144/288] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:05 2022] GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7 => generated 1318 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:06.231243 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f12de8e1-a74b-495b-ab07-38358d7b94e1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:06.240579 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f12de8e1-a74b-495b-ab07-38358d7b94e1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.295261 Jan 19 16:04:06.241948 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 145/289] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:05 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:06.457853 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-72f6c313-2d34-4269-9aeb-dc6ec727e2ff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:06.459764 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-72f6c313-2d34-4269-9aeb-dc6ec727e2ff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:06.467020 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-72f6c313-2d34-4269-9aeb-dc6ec727e2ff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:06.467857 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-72f6c313-2d34-4269-9aeb-dc6ec727e2ff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:06.468834 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-72f6c313-2d34-4269-9aeb-dc6ec727e2ff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:06.469418 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-72f6c313-2d34-4269-9aeb-dc6ec727e2ff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:06.558934 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-72f6c313-2d34-4269-9aeb-dc6ec727e2ff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28205 microversion: 2.20 time: 0.104845 Jan 19 16:04:06.560106 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 145/290] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:06 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28205 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:04:06.677089 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-82645d4b-b660-4347-aeaf-f57259cbc16e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:06.678154 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-82645d4b-b660-4347-aeaf-f57259cbc16e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:06.685010 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-82645d4b-b660-4347-aeaf-f57259cbc16e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:06.685582 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-82645d4b-b660-4347-aeaf-f57259cbc16e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:06.686829 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-82645d4b-b660-4347-aeaf-f57259cbc16e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:06.687328 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-82645d4b-b660-4347-aeaf-f57259cbc16e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:06.781787 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-82645d4b-b660-4347-aeaf-f57259cbc16e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28133 microversion: 2.1 time: 0.109456 Jan 19 16:04:06.782500 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 146/291] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:06 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28133 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:07.027341 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-a2e34ed9-8efc-4dd4-aec4-92f3dc37b151 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:07.030044 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-a2e34ed9-8efc-4dd4-aec4-92f3dc37b151 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: 35008211-e55b-4ef3-99d2-36769725e7d7] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:07.041831 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a2e34ed9-8efc-4dd4-aec4-92f3dc37b151 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:07.043034 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a2e34ed9-8efc-4dd4-aec4-92f3dc37b151 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:07.044812 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a2e34ed9-8efc-4dd4-aec4-92f3dc37b151 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:07.045743 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a2e34ed9-8efc-4dd4-aec4-92f3dc37b151 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:07.262186 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-af41318b-20b0-4116-b6f6-562d797264a4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:07.265985 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-af41318b-20b0-4116-b6f6-562d797264a4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:07.290895 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-af41318b-20b0-4116-b6f6-562d797264a4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:07.291618 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-af41318b-20b0-4116-b6f6-562d797264a4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:07.292923 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-af41318b-20b0-4116-b6f6-562d797264a4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:07.293692 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-af41318b-20b0-4116-b6f6-562d797264a4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:07.305720 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-a2e34ed9-8efc-4dd4-aec4-92f3dc37b151 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:07.328793 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-a2e34ed9-8efc-4dd4-aec4-92f3dc37b151 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7" status: 200 len: 1318 microversion: 2.1 time: 0.309476 Jan 19 16:04:07.330960 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 146/292] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:07 2022] GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7 => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:07.530589 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-af41318b-20b0-4116-b6f6-562d797264a4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:07.541317 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-af41318b-20b0-4116-b6f6-562d797264a4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.286249 Jan 19 16:04:07.542699 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 147/293] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:07 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:07.573637 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-852abbf6-3574-4fc3-a522-b046e7196a3d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:07.575394 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-852abbf6-3574-4fc3-a522-b046e7196a3d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:07.583079 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-852abbf6-3574-4fc3-a522-b046e7196a3d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:07.583792 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-852abbf6-3574-4fc3-a522-b046e7196a3d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:07.584625 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-852abbf6-3574-4fc3-a522-b046e7196a3d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:07.585171 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-852abbf6-3574-4fc3-a522-b046e7196a3d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:07.795589 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e6938260-69e3-49ad-aae9-c3f82d323c26 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:07.796631 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-e6938260-69e3-49ad-aae9-c3f82d323c26 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:07.809377 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e6938260-69e3-49ad-aae9-c3f82d323c26 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:07.810305 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e6938260-69e3-49ad-aae9-c3f82d323c26 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:07.811629 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e6938260-69e3-49ad-aae9-c3f82d323c26 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:07.818286 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e6938260-69e3-49ad-aae9-c3f82d323c26 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:07.857642 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-852abbf6-3574-4fc3-a522-b046e7196a3d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28205 microversion: 2.20 time: 0.288276 Jan 19 16:04:07.858938 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 147/294] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:07 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28205 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:04:07.885477 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e6938260-69e3-49ad-aae9-c3f82d323c26 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28133 microversion: 2.1 time: 0.095153 Jan 19 16:04:07.886264 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 148/295] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:07 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28133 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:04:08.357533 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-3f125f09-0774-43ba-ad57-1416f2740d5c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:08.358487 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-3f125f09-0774-43ba-ad57-1416f2740d5c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: 35008211-e55b-4ef3-99d2-36769725e7d7] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:08.366947 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3f125f09-0774-43ba-ad57-1416f2740d5c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:08.367499 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3f125f09-0774-43ba-ad57-1416f2740d5c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:08.368519 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3f125f09-0774-43ba-ad57-1416f2740d5c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:08.368919 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3f125f09-0774-43ba-ad57-1416f2740d5c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:08.572176 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-affbb9c7-c4c9-46d0-843c-dba9dc1cf4aa tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:08.573496 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-affbb9c7-c4c9-46d0-843c-dba9dc1cf4aa tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:08.584207 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-affbb9c7-c4c9-46d0-843c-dba9dc1cf4aa tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:08.584843 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-affbb9c7-c4c9-46d0-843c-dba9dc1cf4aa tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:08.585620 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-affbb9c7-c4c9-46d0-843c-dba9dc1cf4aa tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:08.586286 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-affbb9c7-c4c9-46d0-843c-dba9dc1cf4aa tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:08.641047 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-3f125f09-0774-43ba-ad57-1416f2740d5c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:08.655608 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-3f125f09-0774-43ba-ad57-1416f2740d5c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7" status: 200 len: 1318 microversion: 2.1 time: 0.301958 Jan 19 16:04:08.656584 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 148/296] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:08 2022] GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7 => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:08.841460 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-affbb9c7-c4c9-46d0-843c-dba9dc1cf4aa tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:08.850427 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-affbb9c7-c4c9-46d0-843c-dba9dc1cf4aa tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.282625 Jan 19 16:04:08.851337 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 149/297] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:08 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:08.869844 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-023c25c6-c78f-4169-acef-e52a72bb7dbd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:08.870804 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-023c25c6-c78f-4169-acef-e52a72bb7dbd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:08.878734 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-023c25c6-c78f-4169-acef-e52a72bb7dbd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:08.879541 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-023c25c6-c78f-4169-acef-e52a72bb7dbd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:08.880379 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-023c25c6-c78f-4169-acef-e52a72bb7dbd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:08.880810 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-023c25c6-c78f-4169-acef-e52a72bb7dbd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:08.899379 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-efb9b4e6-de18-4629-84c7-89d38752c7ff tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:08.900820 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-efb9b4e6-de18-4629-84c7-89d38752c7ff tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:08.909420 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-efb9b4e6-de18-4629-84c7-89d38752c7ff tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:08.910517 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-efb9b4e6-de18-4629-84c7-89d38752c7ff tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:08.911834 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-efb9b4e6-de18-4629-84c7-89d38752c7ff tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:08.912386 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-efb9b4e6-de18-4629-84c7-89d38752c7ff tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:09.128511 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-023c25c6-c78f-4169-acef-e52a72bb7dbd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28205 microversion: 2.20 time: 0.262195 Jan 19 16:04:09.129856 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 149/298] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:08 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28205 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:09.134857 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-efb9b4e6-de18-4629-84c7-89d38752c7ff tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28133 microversion: 2.1 time: 0.238835 Jan 19 16:04:09.136410 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 150/299] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:08 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28133 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:04:09.200856 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-25f741cb-047d-44bb-a0a7-572ac73d48de tempest-VolumesTestJSON-1390523835 tempest-VolumesTestJSON-1390523835-project] Calling method '.version_select at 0x7feff54100d0>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:09.276324 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-25f741cb-047d-44bb-a0a7-572ac73d48de tempest-VolumesTestJSON-1390523835 tempest-VolumesTestJSON-1390523835-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/60ef4893-6a5e-4fde-893e-60c92f0a765b" status: 200 len: 350 microversion: 2.1 time: 0.080084 Jan 19 16:04:09.281058 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 150/300] 10.222.0.58 () {58 vars in 1244 bytes} [Wed Jan 19 16:04:09 2022] GET /compute/v2.1/os-volumes/60ef4893-6a5e-4fde-893e-60c92f0a765b => generated 350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:04:09.674931 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-918faabe-7408-437f-bcb3-87a6e75c45c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:09.676377 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-918faabe-7408-437f-bcb3-87a6e75c45c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: 35008211-e55b-4ef3-99d2-36769725e7d7] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:09.685907 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-918faabe-7408-437f-bcb3-87a6e75c45c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:09.687037 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-918faabe-7408-437f-bcb3-87a6e75c45c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:09.688037 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-918faabe-7408-437f-bcb3-87a6e75c45c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:09.688467 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-918faabe-7408-437f-bcb3-87a6e75c45c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:09.870392 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-30603933-2a8d-489a-85d4-5ab5ebfddcf1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:09.872041 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-30603933-2a8d-489a-85d4-5ab5ebfddcf1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:09.879703 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-30603933-2a8d-489a-85d4-5ab5ebfddcf1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:09.880145 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-30603933-2a8d-489a-85d4-5ab5ebfddcf1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:09.881273 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-30603933-2a8d-489a-85d4-5ab5ebfddcf1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:09.881886 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-30603933-2a8d-489a-85d4-5ab5ebfddcf1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:09.895369 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-918faabe-7408-437f-bcb3-87a6e75c45c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:09.921471 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-918faabe-7408-437f-bcb3-87a6e75c45c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7" status: 200 len: 1318 microversion: 2.1 time: 0.251747 Jan 19 16:04:09.922361 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 151/301] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:09 2022] GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:10.142282 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-0bc72c45-e8d0-4256-81fd-04e599d7ed52 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:10.143584 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-0bc72c45-e8d0-4256-81fd-04e599d7ed52 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:10.159701 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0bc72c45-e8d0-4256-81fd-04e599d7ed52 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:10.160493 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0bc72c45-e8d0-4256-81fd-04e599d7ed52 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:10.161431 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0bc72c45-e8d0-4256-81fd-04e599d7ed52 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:10.161907 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0bc72c45-e8d0-4256-81fd-04e599d7ed52 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:10.207385 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-30603933-2a8d-489a-85d4-5ab5ebfddcf1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:10.247933 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-30603933-2a8d-489a-85d4-5ab5ebfddcf1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1521 microversion: 2.1 time: 0.382018 Jan 19 16:04:10.249170 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 151/302] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:09 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:10.275798 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-4c757af8-5492-4716-ba01-c15d3b72fa95 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:10.279764 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-4c757af8-5492-4716-ba01-c15d3b72fa95 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:10.287126 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4c757af8-5492-4716-ba01-c15d3b72fa95 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:10.287616 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4c757af8-5492-4716-ba01-c15d3b72fa95 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:10.288521 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4c757af8-5492-4716-ba01-c15d3b72fa95 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:10.289012 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4c757af8-5492-4716-ba01-c15d3b72fa95 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:10.323531 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-0bc72c45-e8d0-4256-81fd-04e599d7ed52 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28205 microversion: 2.20 time: 0.177465 Jan 19 16:04:10.324291 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 152/303] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:10 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28205 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:10.539282 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-4c757af8-5492-4716-ba01-c15d3b72fa95 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28133 microversion: 2.1 time: 0.283119 Jan 19 16:04:10.552343 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 152/304] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:10 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28133 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:10.953435 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3d2d9b1f-adc7-4390-a48b-aee94e440f9b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:10.957716 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3d2d9b1f-adc7-4390-a48b-aee94e440f9b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: 35008211-e55b-4ef3-99d2-36769725e7d7] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:11.005874 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3d2d9b1f-adc7-4390-a48b-aee94e440f9b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:11.008340 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3d2d9b1f-adc7-4390-a48b-aee94e440f9b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:11.010448 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3d2d9b1f-adc7-4390-a48b-aee94e440f9b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:11.013157 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3d2d9b1f-adc7-4390-a48b-aee94e440f9b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:11.248577 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-3d2d9b1f-adc7-4390-a48b-aee94e440f9b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:11.261650 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3d2d9b1f-adc7-4390-a48b-aee94e440f9b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7" status: 200 len: 1318 microversion: 2.1 time: 0.320656 Jan 19 16:04:11.262471 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 153/305] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:10 2022] GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:11.278025 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-41a438ed-627b-41ef-9d95-08691d85d9ea tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:11.278866 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-41a438ed-627b-41ef-9d95-08691d85d9ea tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:11.287452 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-41a438ed-627b-41ef-9d95-08691d85d9ea tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:11.287903 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-41a438ed-627b-41ef-9d95-08691d85d9ea tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:11.288877 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-41a438ed-627b-41ef-9d95-08691d85d9ea tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:11.289328 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-41a438ed-627b-41ef-9d95-08691d85d9ea tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:11.340917 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8272c3f7-8843-444c-a816-e5814e9eec48 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:11.342547 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-8272c3f7-8843-444c-a816-e5814e9eec48 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:11.384565 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8272c3f7-8843-444c-a816-e5814e9eec48 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:11.386040 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8272c3f7-8843-444c-a816-e5814e9eec48 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:11.388438 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8272c3f7-8843-444c-a816-e5814e9eec48 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:11.389069 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8272c3f7-8843-444c-a816-e5814e9eec48 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:11.537699 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-8272c3f7-8843-444c-a816-e5814e9eec48 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28205 microversion: 2.20 time: 0.204206 Jan 19 16:04:11.540311 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 154/306] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:11 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28205 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:11.564097 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f7cfad46-fe76-4568-991b-fe03c063ce66 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:11.565537 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f7cfad46-fe76-4568-991b-fe03c063ce66 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:11.573343 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f7cfad46-fe76-4568-991b-fe03c063ce66 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:11.573805 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f7cfad46-fe76-4568-991b-fe03c063ce66 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:11.574810 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f7cfad46-fe76-4568-991b-fe03c063ce66 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:11.575341 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f7cfad46-fe76-4568-991b-fe03c063ce66 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:11.658552 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f7cfad46-fe76-4568-991b-fe03c063ce66 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28133 microversion: 2.1 time: 0.098978 Jan 19 16:04:11.665617 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 155/307] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:11 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28133 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:11.690373 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-41a438ed-627b-41ef-9d95-08691d85d9ea tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:11.701088 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-41a438ed-627b-41ef-9d95-08691d85d9ea tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1501 microversion: 2.1 time: 0.427036 Jan 19 16:04:11.702653 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 153/308] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:11 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1501 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:11.727055 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b586bf5e-6654-49e3-be3a-64e83b92a8bc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:11.728428 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b586bf5e-6654-49e3-be3a-64e83b92a8bc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:11.744666 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b586bf5e-6654-49e3-be3a-64e83b92a8bc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:11.745698 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b586bf5e-6654-49e3-be3a-64e83b92a8bc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:11.747597 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b586bf5e-6654-49e3-be3a-64e83b92a8bc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:11.749179 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b586bf5e-6654-49e3-be3a-64e83b92a8bc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:11.994819 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-b586bf5e-6654-49e3-be3a-64e83b92a8bc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:12.010396 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b586bf5e-6654-49e3-be3a-64e83b92a8bc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1513 microversion: 2.1 time: 0.295563 Jan 19 16:04:12.019774 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 156/309] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:11 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1513 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:12.056090 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-d1eb9fd7-9d8b-4693-8200-31673e523211 req-46bcb26a-d28e-4330-9182-fd31ce0cb301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35008211-e55b-4ef3-99d2-36769725e7d7", "name": "network-vif-plugged", "status": "completed", "tag": "558fd963-51da-4461-b393-d0f82483fa47"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:12.067875 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:04:12.067875 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:04:12.103370 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-d1eb9fd7-9d8b-4693-8200-31673e523211 req-46bcb26a-d28e-4330-9182-fd31ce0cb301 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:12.104489 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-d1eb9fd7-9d8b-4693-8200-31673e523211 req-46bcb26a-d28e-4330-9182-fd31ce0cb301 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:12.133277 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-d1eb9fd7-9d8b-4693-8200-31673e523211 req-46bcb26a-d28e-4330-9182-fd31ce0cb301 service nova] Creating event network-vif-plugged:558fd963-51da-4461-b393-d0f82483fa47 for instance 35008211-e55b-4ef3-99d2-36769725e7d7 on hv-cinder-82002 Jan 19 16:04:12.159172 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-d1eb9fd7-9d8b-4693-8200-31673e523211 req-46bcb26a-d28e-4330-9182-fd31ce0cb301 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113565 Jan 19 16:04:12.160747 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 154/310] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:04:12.313797 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-4e85ce4f-95b7-41a1-b79b-2070f27e7b76 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:12.330218 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-4e85ce4f-95b7-41a1-b79b-2070f27e7b76 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: 35008211-e55b-4ef3-99d2-36769725e7d7] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:12.367684 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4e85ce4f-95b7-41a1-b79b-2070f27e7b76 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:12.368184 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4e85ce4f-95b7-41a1-b79b-2070f27e7b76 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:12.375996 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4e85ce4f-95b7-41a1-b79b-2070f27e7b76 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:12.377971 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4e85ce4f-95b7-41a1-b79b-2070f27e7b76 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:12.557323 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-b092d7a3-ba65-4868-aae1-d8edd60ee473 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:12.558493 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-b092d7a3-ba65-4868-aae1-d8edd60ee473 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:12.570625 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b092d7a3-ba65-4868-aae1-d8edd60ee473 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:12.574193 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b092d7a3-ba65-4868-aae1-d8edd60ee473 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:12.577054 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b092d7a3-ba65-4868-aae1-d8edd60ee473 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:12.578362 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b092d7a3-ba65-4868-aae1-d8edd60ee473 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:12.717523 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-4e85ce4f-95b7-41a1-b79b-2070f27e7b76 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:12.733087 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-b092d7a3-ba65-4868-aae1-d8edd60ee473 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28205 microversion: 2.20 time: 0.178691 Jan 19 16:04:12.737734 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 155/311] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:12 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28205 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:04:12.754329 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-4e85ce4f-95b7-41a1-b79b-2070f27e7b76 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7" status: 200 len: 1318 microversion: 2.1 time: 0.464303 Jan 19 16:04:12.755788 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 157/312] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:12 2022] GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7 => generated 1318 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:12.757521 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-b0535192-f358-40bb-a0a6-dc106e82e173 tempest-VolumesTestJSON-1390523835 tempest-VolumesTestJSON-1390523835-project] Calling method '.version_select at 0x7feff5402a60>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:12.763046 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3cb93631-d67d-4e29-b921-9a3ff938c0b3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:12.764299 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3cb93631-d67d-4e29-b921-9a3ff938c0b3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:12.780299 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3cb93631-d67d-4e29-b921-9a3ff938c0b3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:12.781128 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3cb93631-d67d-4e29-b921-9a3ff938c0b3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:12.785115 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3cb93631-d67d-4e29-b921-9a3ff938c0b3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:12.785844 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3cb93631-d67d-4e29-b921-9a3ff938c0b3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:12.906043 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3cb93631-d67d-4e29-b921-9a3ff938c0b3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28133 microversion: 2.1 time: 0.148406 Jan 19 16:04:12.913058 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 158/313] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:12 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28133 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:12.926859 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-b0535192-f358-40bb-a0a6-dc106e82e173 tempest-VolumesTestJSON-1390523835 tempest-VolumesTestJSON-1390523835-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/b6361e98-ac50-4f09-8623-f090edab7236" status: 200 len: 351 microversion: 2.1 time: 0.184212 Jan 19 16:04:12.928761 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 156/314] 10.222.0.58 () {58 vars in 1244 bytes} [Wed Jan 19 16:04:12 2022] GET /compute/v2.1/os-volumes/b6361e98-ac50-4f09-8623-f090edab7236 => generated 351 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:04:13.836087 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-599139eb-af54-4dcf-a73f-6b41311c4ec7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:13.836087 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-599139eb-af54-4dcf-a73f-6b41311c4ec7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:13.836087 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-599139eb-af54-4dcf-a73f-6b41311c4ec7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:13.836087 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-599139eb-af54-4dcf-a73f-6b41311c4ec7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:13.998699 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-599139eb-af54-4dcf-a73f-6b41311c4ec7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:13.998699 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-599139eb-af54-4dcf-a73f-6b41311c4ec7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:14.003211 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-a6165018-f221-491c-a64a-087f6a19cb11 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:14.003211 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-a6165018-f221-491c-a64a-087f6a19cb11 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: 35008211-e55b-4ef3-99d2-36769725e7d7] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:14.003211 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a6165018-f221-491c-a64a-087f6a19cb11 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:14.003211 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a6165018-f221-491c-a64a-087f6a19cb11 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:14.007322 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a6165018-f221-491c-a64a-087f6a19cb11 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:14.007322 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a6165018-f221-491c-a64a-087f6a19cb11 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:14.008772 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-599139eb-af54-4dcf-a73f-6b41311c4ec7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28205 microversion: 2.20 time: 0.127035 Jan 19 16:04:14.008772 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 159/315] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:13 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28205 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:04:14.008772 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c9bfd662-e4f4-467a-8486-c7d639b05de2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:14.008772 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c9bfd662-e4f4-467a-8486-c7d639b05de2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:14.008772 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c9bfd662-e4f4-467a-8486-c7d639b05de2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:14.015692 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c9bfd662-e4f4-467a-8486-c7d639b05de2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:14.015692 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c9bfd662-e4f4-467a-8486-c7d639b05de2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:14.015692 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c9bfd662-e4f4-467a-8486-c7d639b05de2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:14.016930 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-a6165018-f221-491c-a64a-087f6a19cb11 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:14.032925 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-a6165018-f221-491c-a64a-087f6a19cb11 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7" status: 200 len: 1318 microversion: 2.1 time: 0.261864 Jan 19 16:04:14.040096 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 157/316] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:13 2022] GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:14.126094 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c9bfd662-e4f4-467a-8486-c7d639b05de2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28133 microversion: 2.1 time: 0.207961 Jan 19 16:04:14.127876 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 160/317] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:13 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28133 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:04:14.887344 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6f5fc016-26da-415c-bcdc-8c058569cf40 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:14.887344 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-6f5fc016-26da-415c-bcdc-8c058569cf40 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:14.894907 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6f5fc016-26da-415c-bcdc-8c058569cf40 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:14.895931 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6f5fc016-26da-415c-bcdc-8c058569cf40 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:14.898435 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6f5fc016-26da-415c-bcdc-8c058569cf40 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:14.901174 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6f5fc016-26da-415c-bcdc-8c058569cf40 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:15.020898 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6f5fc016-26da-415c-bcdc-8c058569cf40 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28205 microversion: 2.20 time: 0.138884 Jan 19 16:04:15.022739 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 158/318] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:14 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28205 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:15.053382 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ecc6f4cf-2be5-462f-91f7-c28aaa72d534 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:15.054201 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ecc6f4cf-2be5-462f-91f7-c28aaa72d534 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: 35008211-e55b-4ef3-99d2-36769725e7d7] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:15.067851 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ecc6f4cf-2be5-462f-91f7-c28aaa72d534 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:15.070118 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ecc6f4cf-2be5-462f-91f7-c28aaa72d534 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:15.072852 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ecc6f4cf-2be5-462f-91f7-c28aaa72d534 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:15.073620 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ecc6f4cf-2be5-462f-91f7-c28aaa72d534 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:15.148429 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-87bc4164-fa01-4ba9-be63-0443b5abaf8e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:15.149546 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-87bc4164-fa01-4ba9-be63-0443b5abaf8e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:15.164976 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-87bc4164-fa01-4ba9-be63-0443b5abaf8e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:15.166250 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-87bc4164-fa01-4ba9-be63-0443b5abaf8e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:15.166250 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-87bc4164-fa01-4ba9-be63-0443b5abaf8e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:15.166574 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-87bc4164-fa01-4ba9-be63-0443b5abaf8e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:15.267430 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ecc6f4cf-2be5-462f-91f7-c28aaa72d534 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:15.276540 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ecc6f4cf-2be5-462f-91f7-c28aaa72d534 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7" status: 200 len: 1509 microversion: 2.1 time: 0.228142 Jan 19 16:04:15.278346 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 161/319] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:15 2022] GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7 => generated 1509 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:15.283848 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-87bc4164-fa01-4ba9-be63-0443b5abaf8e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28133 microversion: 2.1 time: 0.137645 Jan 19 16:04:15.287906 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 159/320] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:15 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28133 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:04:15.308800 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f0f2de46-a9f2-4265-a6e3-e704899debac tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acd4a663-e19d-4a10-bdc1-0c982e720727"}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:15.309995 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f0f2de46-a9f2-4265-a6e3-e704899debac tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: 35008211-e55b-4ef3-99d2-36769725e7d7] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:15.320795 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f0f2de46-a9f2-4265-a6e3-e704899debac tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:15.321260 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f0f2de46-a9f2-4265-a6e3-e704899debac tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:15.323894 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f0f2de46-a9f2-4265-a6e3-e704899debac tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:15.324347 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f0f2de46-a9f2-4265-a6e3-e704899debac tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:15.495991 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-2f77ed0f-58fa-442a-9ccd-c2e5e755de78 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:15.498464 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-2f77ed0f-58fa-442a-9ccd-c2e5e755de78 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:15.514771 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2f77ed0f-58fa-442a-9ccd-c2e5e755de78 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:15.516025 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2f77ed0f-58fa-442a-9ccd-c2e5e755de78 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:15.518811 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2f77ed0f-58fa-442a-9ccd-c2e5e755de78 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:15.519942 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2f77ed0f-58fa-442a-9ccd-c2e5e755de78 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:15.566770 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.wsgi [None req-f0f2de46-a9f2-4265-a6e3-e704899debac tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] HTTP exception thrown: Invalid volume: volume acd4a663-e19d-4a10-bdc1-0c982e720727 is already attached to instances: cf8c20cd-e1b6-415c-9811-c58dbcf31b49 Jan 19 16:04:15.567421 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f0f2de46-a9f2-4265-a6e3-e704899debac tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Returning 400 to user: Invalid volume: volume acd4a663-e19d-4a10-bdc1-0c982e720727 is already attached to instances: cf8c20cd-e1b6-415c-9811-c58dbcf31b49 {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:04:15.568488 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f0f2de46-a9f2-4265-a6e3-e704899debac tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "POST /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.264182 Jan 19 16:04:15.569403 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 162/321] 10.222.0.58 () {60 vars in 1322 bytes} [Wed Jan 19 16:04:15 2022] POST /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7/os-volume_attachments => generated 174 bytes in 266 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:04:15.575127 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.objects.instance [None req-2f77ed0f-58fa-442a-9ccd-c2e5e755de78 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lazy-loading 'flavor' on Instance uuid 808abc0b-bb27-496f-8ce0-d536ab3d1ffb {{(pid=128875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:04:15.640367 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-181c52c5-319b-4663-8329-ed86738a004a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:15.641104 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-181c52c5-319b-4663-8329-ed86738a004a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:15.648811 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-181c52c5-319b-4663-8329-ed86738a004a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:15.649277 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-181c52c5-319b-4663-8329-ed86738a004a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:15.650097 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-181c52c5-319b-4663-8329-ed86738a004a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:15.650542 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-181c52c5-319b-4663-8329-ed86738a004a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:15.828168 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.objects.instance [None req-181c52c5-319b-4663-8329-ed86738a004a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lazy-loading 'services' on Instance uuid cf8c20cd-e1b6-415c-9811-c58dbcf31b49 {{(pid=128876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:04:16.218368 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-181c52c5-319b-4663-8329-ed86738a004a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49/os-volume_attachments/acd4a663-e19d-4a10-bdc1-0c982e720727" status: 202 len: 0 microversion: 2.1 time: 0.581511 Jan 19 16:04:16.221533 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-2f77ed0f-58fa-442a-9ccd-c2e5e755de78 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "POST /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/action" status: 200 len: 32 microversion: 2.1 time: 0.732740 Jan 19 16:04:16.221533 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 160/322] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:15 2022] POST /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/action => generated 32 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:04:16.222374 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 163/323] 10.222.0.58 () {58 vars in 1415 bytes} [Wed Jan 19 16:04:15 2022] DELETE /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49/os-volume_attachments/acd4a663-e19d-4a10-bdc1-0c982e720727 => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:16.240436 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-74ebead7-9a3a-4855-9f41-0f0f253c5c7c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:16.245171 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-0273ebb5-8e31-4b19-a468-f48cf1e14b53 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:16.248583 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-74ebead7-9a3a-4855-9f41-0f0f253c5c7c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:16.249767 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-0273ebb5-8e31-4b19-a468-f48cf1e14b53 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:16.266337 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0273ebb5-8e31-4b19-a468-f48cf1e14b53 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:16.267535 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0273ebb5-8e31-4b19-a468-f48cf1e14b53 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:16.269167 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0273ebb5-8e31-4b19-a468-f48cf1e14b53 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:16.269785 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-74ebead7-9a3a-4855-9f41-0f0f253c5c7c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:16.270360 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-74ebead7-9a3a-4855-9f41-0f0f253c5c7c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:16.271319 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0273ebb5-8e31-4b19-a468-f48cf1e14b53 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:16.271746 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-74ebead7-9a3a-4855-9f41-0f0f253c5c7c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:16.272495 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-74ebead7-9a3a-4855-9f41-0f0f253c5c7c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:16.408535 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-0273ebb5-8e31-4b19-a468-f48cf1e14b53 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28205 microversion: 2.20 time: 0.186164 Jan 19 16:04:16.409452 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 161/324] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:16 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28205 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:16.421501 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-75b47410-6a03-49f0-91a2-ab6190c80b7b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:16.424300 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-75b47410-6a03-49f0-91a2-ab6190c80b7b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:16.436087 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-75b47410-6a03-49f0-91a2-ab6190c80b7b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:16.436901 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-75b47410-6a03-49f0-91a2-ab6190c80b7b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:16.437950 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-75b47410-6a03-49f0-91a2-ab6190c80b7b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:16.438667 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-75b47410-6a03-49f0-91a2-ab6190c80b7b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:16.492621 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-75b47410-6a03-49f0-91a2-ab6190c80b7b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081757 Jan 19 16:04:16.497453 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 162/325] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:04:16 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:04:16.510321 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-040db664-e74a-4be4-8565-9975f5a52194 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:16.513667 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-040db664-e74a-4be4-8565-9975f5a52194 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:16.556893 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-040db664-e74a-4be4-8565-9975f5a52194 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:16.559454 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-040db664-e74a-4be4-8565-9975f5a52194 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:16.563399 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-040db664-e74a-4be4-8565-9975f5a52194 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:16.567855 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-040db664-e74a-4be4-8565-9975f5a52194 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:16.689166 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-040db664-e74a-4be4-8565-9975f5a52194 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28133 microversion: 2.1 time: 0.189322 Jan 19 16:04:16.690560 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 163/326] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:16 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28133 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:16.701593 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6f858fdf-acf8-47a1-b3b8-9340d9d6465b tempest-VolumesTestJSON-1390523835 tempest-VolumesTestJSON-1390523835-project] Calling method '.version_select at 0x7feff5478dc0>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:16.752465 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-74ebead7-9a3a-4855-9f41-0f0f253c5c7c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:16.786020 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-74ebead7-9a3a-4855-9f41-0f0f253c5c7c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1519 microversion: 2.1 time: 0.558018 Jan 19 16:04:16.787495 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 164/327] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:16 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1519 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:16.806499 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6f858fdf-acf8-47a1-b3b8-9340d9d6465b tempest-VolumesTestJSON-1390523835 tempest-VolumesTestJSON-1390523835-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/ef6e1592-cebd-4d39-a742-970a294ec250" status: 200 len: 350 microversion: 2.1 time: 0.114465 Jan 19 16:04:16.813455 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 164/328] 10.222.0.58 () {58 vars in 1244 bytes} [Wed Jan 19 16:04:16 2022] GET /compute/v2.1/os-volumes/ef6e1592-cebd-4d39-a742-970a294ec250 => generated 350 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:04:16.821300 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-13855b3e-7d61-4439-83da-42d56f7c5382 tempest-VolumesTestJSON-1390523835 tempest-VolumesTestJSON-1390523835-project] Calling method '.version_select at 0x7feff53d8ca0>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:17.020284 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-13855b3e-7d61-4439-83da-42d56f7c5382 tempest-VolumesTestJSON-1390523835 tempest-VolumesTestJSON-1390523835-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.204074 Jan 19 16:04:17.032467 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 165/329] 10.222.0.58 () {58 vars in 1133 bytes} [Wed Jan 19 16:04:16 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:17.034544 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-427cdfb3-a999-42c0-886d-d4a925b1b15e tempest-VolumesTestJSON-1390523835 tempest-VolumesTestJSON-1390523835-project] Calling method '.version_select at 0x7feff53d9e50>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:17.186789 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-427cdfb3-a999-42c0-886d-d4a925b1b15e tempest-VolumesTestJSON-1390523835 tempest-VolumesTestJSON-1390523835-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.157584 Jan 19 16:04:17.195548 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 165/330] 10.222.0.58 () {58 vars in 1148 bytes} [Wed Jan 19 16:04:17 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:04:17.208741 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-945f08df-9699-49b3-8396-56fa8c8736a1 tempest-VolumesTestJSON-1390523835 tempest-VolumesTestJSON-1390523835-project] Calling method '.version_select at 0x7feff53bd430>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:17.316420 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-945f08df-9699-49b3-8396-56fa8c8736a1 tempest-VolumesTestJSON-1390523835 tempest-VolumesTestJSON-1390523835-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.118995 Jan 19 16:04:17.327510 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 166/331] 10.222.0.58 () {58 vars in 1133 bytes} [Wed Jan 19 16:04:17 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:17.328234 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-91b52b92-8854-455b-8c51-66d8a55fbfa9 tempest-VolumesTestJSON-1390523835 tempest-VolumesTestJSON-1390523835-project] Calling method '.version_select at 0x7feff53ca430>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:17.417995 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-91b52b92-8854-455b-8c51-66d8a55fbfa9 tempest-VolumesTestJSON-1390523835 tempest-VolumesTestJSON-1390523835-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.093380 Jan 19 16:04:17.423679 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d4a9ccc4-9cbd-465a-96f3-2ac6307a95f7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:17.424612 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-d4a9ccc4-9cbd-465a-96f3-2ac6307a95f7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:17.427284 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 166/332] 10.222.0.58 () {58 vars in 1166 bytes} [Wed Jan 19 16:04:17 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:04:17.441211 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-a01e65da-40ac-4f16-949b-2eaa303e2ba0 tempest-VolumesTestJSON-1390523835 tempest-VolumesTestJSON-1390523835-project] Calling method '.version_select at 0x7feff53273a0>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:17.455722 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d4a9ccc4-9cbd-465a-96f3-2ac6307a95f7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:17.456171 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d4a9ccc4-9cbd-465a-96f3-2ac6307a95f7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:17.457171 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d4a9ccc4-9cbd-465a-96f3-2ac6307a95f7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:17.457791 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d4a9ccc4-9cbd-465a-96f3-2ac6307a95f7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:17.542923 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-d4a9ccc4-9cbd-465a-96f3-2ac6307a95f7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28205 microversion: 2.20 time: 0.123141 Jan 19 16:04:17.554868 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 167/333] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:17 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28205 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:17.561409 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d2914a93-7ac7-4774-b8c3-ffba5a83ce10 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:17.562637 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-d2914a93-7ac7-4774-b8c3-ffba5a83ce10 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:17.572120 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d2914a93-7ac7-4774-b8c3-ffba5a83ce10 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:17.572803 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d2914a93-7ac7-4774-b8c3-ffba5a83ce10 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:17.574276 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d2914a93-7ac7-4774-b8c3-ffba5a83ce10 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:17.574929 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d2914a93-7ac7-4774-b8c3-ffba5a83ce10 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:17.646486 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-d2914a93-7ac7-4774-b8c3-ffba5a83ce10 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066727 Jan 19 16:04:17.647989 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 168/334] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:04:17 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:04:17.702063 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-a01e65da-40ac-4f16-949b-2eaa303e2ba0 tempest-VolumesTestJSON-1390523835 tempest-VolumesTestJSON-1390523835-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.265776 Jan 19 16:04:17.703048 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 167/335] 10.222.0.58 () {58 vars in 1169 bytes} [Wed Jan 19 16:04:17 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:04:17.708653 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-1c97cf57-96b0-41b5-8bbb-e20d2a66eea9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:17.710420 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-1c97cf57-96b0-41b5-8bbb-e20d2a66eea9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:17.728759 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-3ad2133a-f040-4396-83a2-1f688b5b5c43 tempest-VolumesTestJSON-1390523835 tempest-VolumesTestJSON-1390523835-project] Calling method '.version_select at 0x7feff53d94c0>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:17.746238 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1c97cf57-96b0-41b5-8bbb-e20d2a66eea9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:17.749480 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1c97cf57-96b0-41b5-8bbb-e20d2a66eea9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:17.757572 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1c97cf57-96b0-41b5-8bbb-e20d2a66eea9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:17.757572 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1c97cf57-96b0-41b5-8bbb-e20d2a66eea9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:17.927859 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-3ad2133a-f040-4396-83a2-1f688b5b5c43 tempest-VolumesTestJSON-1390523835 tempest-VolumesTestJSON-1390523835-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.207915 Jan 19 16:04:17.929217 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 168/336] 10.222.0.58 () {58 vars in 1154 bytes} [Wed Jan 19 16:04:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:17.941121 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-1c97cf57-96b0-41b5-8bbb-e20d2a66eea9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28133 microversion: 2.1 time: 0.231618 Jan 19 16:04:17.941121 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 169/337] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:17 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28133 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:17.948547 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e2db85c3-eeb7-4c72-b3c0-9709f7d15dcc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:17.949366 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-e2db85c3-eeb7-4c72-b3c0-9709f7d15dcc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:17.953679 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-62e2ffd1-6379-4d29-ab18-b4f6b0ab76b2 tempest-VolumesTestJSON-1390523835 tempest-VolumesTestJSON-1390523835-project] Calling method '.version_select at 0x7feff53d9790>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:17.964308 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e2db85c3-eeb7-4c72-b3c0-9709f7d15dcc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:17.965129 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e2db85c3-eeb7-4c72-b3c0-9709f7d15dcc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:17.969686 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e2db85c3-eeb7-4c72-b3c0-9709f7d15dcc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:17.970395 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e2db85c3-eeb7-4c72-b3c0-9709f7d15dcc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:18.281022 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-62e2ffd1-6379-4d29-ab18-b4f6b0ab76b2 tempest-VolumesTestJSON-1390523835 tempest-VolumesTestJSON-1390523835-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.335466 Jan 19 16:04:18.282033 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 169/338] 10.222.0.58 () {58 vars in 1187 bytes} [Wed Jan 19 16:04:17 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:04:18.306945 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-42e60f51-292b-4fd6-aa76-3a594f161023 tempest-VolumesTestJSON-1390523835 tempest-VolumesTestJSON-1390523835-project] Calling method '.version_select at 0x7feff53caaf0>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:18.475877 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e2db85c3-eeb7-4c72-b3c0-9709f7d15dcc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:18.484359 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e2db85c3-eeb7-4c72-b3c0-9709f7d15dcc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1519 microversion: 2.1 time: 0.547712 Jan 19 16:04:18.487180 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 170/339] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:17 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1519 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:18.569295 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-9f204a2e-0705-4cb2-bf18-bd5190599db7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:18.571386 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-9f204a2e-0705-4cb2-bf18-bd5190599db7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:18.581492 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9f204a2e-0705-4cb2-bf18-bd5190599db7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:18.582347 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9f204a2e-0705-4cb2-bf18-bd5190599db7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:18.583434 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9f204a2e-0705-4cb2-bf18-bd5190599db7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:18.584086 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9f204a2e-0705-4cb2-bf18-bd5190599db7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:18.627450 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-42e60f51-292b-4fd6-aa76-3a594f161023 tempest-VolumesTestJSON-1390523835 tempest-VolumesTestJSON-1390523835-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.330070 Jan 19 16:04:18.629796 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 170/340] 10.222.0.58 () {58 vars in 1154 bytes} [Wed Jan 19 16:04:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:18.661440 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f5d302ab-416f-4e98-83c6-4c6b293b490d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:18.666364 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-f5d302ab-416f-4e98-83c6-4c6b293b490d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:18.676859 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-9f204a2e-0705-4cb2-bf18-bd5190599db7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28205 microversion: 2.20 time: 0.111721 Jan 19 16:04:18.677769 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 171/341] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:18 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28205 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:04:18.684635 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f5d302ab-416f-4e98-83c6-4c6b293b490d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:18.685872 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f5d302ab-416f-4e98-83c6-4c6b293b490d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:18.687630 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f5d302ab-416f-4e98-83c6-4c6b293b490d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:18.689605 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f5d302ab-416f-4e98-83c6-4c6b293b490d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:18.749079 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f5d302ab-416f-4e98-83c6-4c6b293b490d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094590 Jan 19 16:04:18.763137 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 171/342] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:04:18 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:04:18.971393 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c3f312b9-077f-4067-b442-cf2cfc423c0b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:18.973024 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c3f312b9-077f-4067-b442-cf2cfc423c0b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:19.002624 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c3f312b9-077f-4067-b442-cf2cfc423c0b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:19.004122 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c3f312b9-077f-4067-b442-cf2cfc423c0b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:19.008357 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c3f312b9-077f-4067-b442-cf2cfc423c0b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:19.011892 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c3f312b9-077f-4067-b442-cf2cfc423c0b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:19.110685 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c3f312b9-077f-4067-b442-cf2cfc423c0b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28133 microversion: 2.1 time: 0.159488 Jan 19 16:04:19.116288 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 172/343] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:18 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28133 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:19.122675 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e1e8c213-0c63-4c35-b7af-a108be55a3c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-225576885", "imageRef": "6d9c05bd-015a-44de-bd51-f744cb247e7a", "flavorRef": "452", "networks": [{"uuid": "d642b74e-4dc9-4613-8da6-c9feaf68b80d"}]}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:19.197169 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.network.neutron [None req-e1e8c213-0c63-4c35-b7af-a108be55a3c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] validate_networks() for [('d642b74e-4dc9-4613-8da6-c9feaf68b80d', None, None, None, None, None)] {{(pid=128876) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:04:19.336903 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e7e9ccad-e50a-46f0-a71a-30caf84085e0 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Action: 'create', calling method: .version_select at 0x7feff53d9d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1630068289"}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:19.397430 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-e7e9ccad-e50a-46f0-a71a-30caf84085e0 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Getting quotas for project ee1086833404449a901e9a13cc93c8b5. Resources: {'key_pairs'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:04:19.414566 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-e7e9ccad-e50a-46f0-a71a-30caf84085e0 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Getting quotas for user 054c8acefa4240469678db612ea73c33 and project ee1086833404449a901e9a13cc93c8b5. Resources: {'key_pairs'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:04:19.670507 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-e1e8c213-0c63-4c35-b7af-a108be55a3c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Flavor limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:04:19.671047 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-e1e8c213-0c63-4c35-b7af-a108be55a3c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Image limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:04:19.671421 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-e1e8c213-0c63-4c35-b7af-a108be55a3c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Flavor pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:04:19.671819 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-e1e8c213-0c63-4c35-b7af-a108be55a3c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Image pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:04:19.672899 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-e1e8c213-0c63-4c35-b7af-a108be55a3c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:04:19.688513 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e1e8c213-0c63-4c35-b7af-a108be55a3c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:19.697385 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e1e8c213-0c63-4c35-b7af-a108be55a3c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:19.697385 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e1e8c213-0c63-4c35-b7af-a108be55a3c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:19.697385 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e1e8c213-0c63-4c35-b7af-a108be55a3c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:19.715001 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-e1e8c213-0c63-4c35-b7af-a108be55a3c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Getting quotas for project a7e40e4efd974d37820bb6724978d22f. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:04:19.721282 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-e1e8c213-0c63-4c35-b7af-a108be55a3c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Getting quotas for user 3f7ace876fa34fe688d055a4a5fb1fdb and project a7e40e4efd974d37820bb6724978d22f. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:04:19.736567 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-e1e8c213-0c63-4c35-b7af-a108be55a3c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Going to run 1 instances... {{(pid=128876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:04:19.746506 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-e1e8c213-0c63-4c35-b7af-a108be55a3c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6d9c05bd-015a-44de-bd51-f744cb247e7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:04:19.749024 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-e7e9ccad-e50a-46f0-a71a-30caf84085e0 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Getting quotas for project ee1086833404449a901e9a13cc93c8b5. Resources: {'key_pairs'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:04:19.756887 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-e7e9ccad-e50a-46f0-a71a-30caf84085e0 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Getting quotas for user 054c8acefa4240469678db612ea73c33 and project ee1086833404449a901e9a13cc93c8b5. Resources: {'key_pairs'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:04:19.780424 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e7e9ccad-e50a-46f0-a71a-30caf84085e0 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.789471 Jan 19 16:04:19.780424 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 172/344] 10.222.0.58 () {60 vars in 1157 bytes} [Wed Jan 19 16:04:18 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:19.783484 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-7347b620-b753-4656-a806-91b635549cee tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:19.784199 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-7347b620-b753-4656-a806-91b635549cee tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:19.796847 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7347b620-b753-4656-a806-91b635549cee tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:19.797706 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7347b620-b753-4656-a806-91b635549cee tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:19.798630 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7347b620-b753-4656-a806-91b635549cee tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:19.799431 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7347b620-b753-4656-a806-91b635549cee tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:19.904985 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e1e8c213-0c63-4c35-b7af-a108be55a3c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.786427 Jan 19 16:04:19.907386 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 173/345] 10.222.0.58 () {60 vars in 1146 bytes} [Wed Jan 19 16:04:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:04:19.932979 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-4d75dc72-fb4d-4928-8edc-bc7bec47bc88 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:19.934097 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-4d75dc72-fb4d-4928-8edc-bc7bec47bc88 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:19.947816 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4d75dc72-fb4d-4928-8edc-bc7bec47bc88 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:19.948252 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4d75dc72-fb4d-4928-8edc-bc7bec47bc88 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:19.950424 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4d75dc72-fb4d-4928-8edc-bc7bec47bc88 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:19.950872 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4d75dc72-fb4d-4928-8edc-bc7bec47bc88 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:20.070068 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-4d75dc72-fb4d-4928-8edc-bc7bec47bc88 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28205 microversion: 2.20 time: 0.160377 Jan 19 16:04:20.074773 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 174/346] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:19 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28205 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:20.088573 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-7347b620-b753-4656-a806-91b635549cee tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:20.105614 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5496835e-6d85-4e7f-9c3a-d2660f7b29bf tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:20.107087 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5496835e-6d85-4e7f-9c3a-d2660f7b29bf tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:20.107269 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-7347b620-b753-4656-a806-91b635549cee tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1519 microversion: 2.1 time: 0.330453 Jan 19 16:04:20.108621 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 173/347] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:19 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1519 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:20.130874 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-dd7921ae-3bb2-4a23-b954-2753933c70a3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:20.132815 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-dd7921ae-3bb2-4a23-b954-2753933c70a3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:20.142636 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-dd7921ae-3bb2-4a23-b954-2753933c70a3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:20.149385 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-dd7921ae-3bb2-4a23-b954-2753933c70a3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:20.159886 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-dd7921ae-3bb2-4a23-b954-2753933c70a3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:20.160622 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-dd7921ae-3bb2-4a23-b954-2753933c70a3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:20.224126 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5496835e-6d85-4e7f-9c3a-d2660f7b29bf tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:20.236790 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5496835e-6d85-4e7f-9c3a-d2660f7b29bf tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1217 microversion: 2.1 time: 0.160481 Jan 19 16:04:20.237783 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 175/348] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:20 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:20.293764 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-dd7921ae-3bb2-4a23-b954-2753933c70a3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28423 microversion: 2.1 time: 0.169688 Jan 19 16:04:20.299690 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 174/349] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:20 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28423 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:04:21.082190 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3808768b-4655-43a3-b79f-e5e8fb44ba0e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:21.083098 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3808768b-4655-43a3-b79f-e5e8fb44ba0e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:21.096533 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3808768b-4655-43a3-b79f-e5e8fb44ba0e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:21.104391 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3808768b-4655-43a3-b79f-e5e8fb44ba0e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:21.104391 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3808768b-4655-43a3-b79f-e5e8fb44ba0e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:21.104391 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3808768b-4655-43a3-b79f-e5e8fb44ba0e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:21.129103 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-2655ad5a-f290-46c9-a861-ebb8d68c1c1a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:21.130454 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-2655ad5a-f290-46c9-a861-ebb8d68c1c1a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:21.139310 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2655ad5a-f290-46c9-a861-ebb8d68c1c1a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:21.144891 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2655ad5a-f290-46c9-a861-ebb8d68c1c1a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:21.144891 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2655ad5a-f290-46c9-a861-ebb8d68c1c1a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:21.144891 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2655ad5a-f290-46c9-a861-ebb8d68c1c1a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:21.232188 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3808768b-4655-43a3-b79f-e5e8fb44ba0e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28495 microversion: 2.20 time: 0.153159 Jan 19 16:04:21.234360 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 176/350] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:21 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28495 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:21.261773 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-08ce173c-69fc-4c8d-992c-a0140881efc8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:21.264447 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-08ce173c-69fc-4c8d-992c-a0140881efc8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:21.427738 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-08ce173c-69fc-4c8d-992c-a0140881efc8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:21.452490 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-08ce173c-69fc-4c8d-992c-a0140881efc8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1217 microversion: 2.1 time: 0.198464 Jan 19 16:04:21.453326 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 177/351] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:21 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1217 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:21.474081 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d75258aa-fff5-448e-99a1-4c1a68d7cbbf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:21.476457 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-d75258aa-fff5-448e-99a1-4c1a68d7cbbf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:21.490522 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-2655ad5a-f290-46c9-a861-ebb8d68c1c1a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:21.507616 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d75258aa-fff5-448e-99a1-4c1a68d7cbbf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:21.508506 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d75258aa-fff5-448e-99a1-4c1a68d7cbbf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:21.509813 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-2655ad5a-f290-46c9-a861-ebb8d68c1c1a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1519 microversion: 2.1 time: 0.384619 Jan 19 16:04:21.510046 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d75258aa-fff5-448e-99a1-4c1a68d7cbbf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:21.510635 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d75258aa-fff5-448e-99a1-4c1a68d7cbbf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:21.539519 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 175/352] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:21 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1519 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:21.689944 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-d75258aa-fff5-448e-99a1-4c1a68d7cbbf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28423 microversion: 2.1 time: 0.234696 Jan 19 16:04:21.690641 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 178/353] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:21 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28423 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:22.248312 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-4be1439f-064c-4919-9e33-a01ac8f22ce4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:22.250245 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-4be1439f-064c-4919-9e33-a01ac8f22ce4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:22.264377 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4be1439f-064c-4919-9e33-a01ac8f22ce4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:22.273321 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4be1439f-064c-4919-9e33-a01ac8f22ce4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:22.274880 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4be1439f-064c-4919-9e33-a01ac8f22ce4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:22.276224 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4be1439f-064c-4919-9e33-a01ac8f22ce4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:22.404126 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-4be1439f-064c-4919-9e33-a01ac8f22ce4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28495 microversion: 2.20 time: 0.138632 Jan 19 16:04:22.404126 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 176/354] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:22 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28495 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:22.492658 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-6e2f36b0-bbfc-452d-a329-b2c7beac90ae tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:22.493754 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-6e2f36b0-bbfc-452d-a329-b2c7beac90ae tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:22.502749 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6e2f36b0-bbfc-452d-a329-b2c7beac90ae tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:22.503528 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6e2f36b0-bbfc-452d-a329-b2c7beac90ae tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:22.504534 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6e2f36b0-bbfc-452d-a329-b2c7beac90ae tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:22.505131 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6e2f36b0-bbfc-452d-a329-b2c7beac90ae tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:22.544314 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-8212b9c9-1dee-42b6-9c34-86c748b1d942 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:22.545503 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8212b9c9-1dee-42b6-9c34-86c748b1d942 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:22.555860 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8212b9c9-1dee-42b6-9c34-86c748b1d942 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:22.560209 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8212b9c9-1dee-42b6-9c34-86c748b1d942 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:22.560209 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8212b9c9-1dee-42b6-9c34-86c748b1d942 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:22.560209 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8212b9c9-1dee-42b6-9c34-86c748b1d942 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:22.595757 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-6e2f36b0-bbfc-452d-a329-b2c7beac90ae tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:22.617550 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-6e2f36b0-bbfc-452d-a329-b2c7beac90ae tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1269 microversion: 2.1 time: 0.136525 Jan 19 16:04:22.618160 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 179/355] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:22 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1269 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:22.709154 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-7d4e1338-d8fe-44cd-bb3b-b907bb147471 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:22.710558 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-7d4e1338-d8fe-44cd-bb3b-b907bb147471 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:22.723363 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7d4e1338-d8fe-44cd-bb3b-b907bb147471 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:22.725182 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7d4e1338-d8fe-44cd-bb3b-b907bb147471 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:22.725182 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7d4e1338-d8fe-44cd-bb3b-b907bb147471 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:22.725666 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7d4e1338-d8fe-44cd-bb3b-b907bb147471 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:22.779271 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8212b9c9-1dee-42b6-9c34-86c748b1d942 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:22.789997 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-8212b9c9-1dee-42b6-9c34-86c748b1d942 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1519 microversion: 2.1 time: 0.250573 Jan 19 16:04:22.805157 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 177/356] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:22 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1519 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:22.852999 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-7d4e1338-d8fe-44cd-bb3b-b907bb147471 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.148369 Jan 19 16:04:22.863191 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 180/357] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:22 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:23.398295 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-898a066a-943a-4a0f-8cc8-2bacc00fb533 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:23.399318 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-898a066a-943a-4a0f-8cc8-2bacc00fb533 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:23.411885 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-898a066a-943a-4a0f-8cc8-2bacc00fb533 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:23.411885 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-898a066a-943a-4a0f-8cc8-2bacc00fb533 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:23.411885 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-898a066a-943a-4a0f-8cc8-2bacc00fb533 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:23.412235 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-898a066a-943a-4a0f-8cc8-2bacc00fb533 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:23.511261 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-898a066a-943a-4a0f-8cc8-2bacc00fb533 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.117547 Jan 19 16:04:23.515259 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 178/358] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:23 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:23.636288 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-57856e0f-54b1-4ba3-a7f3-b7c0f709980a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:23.637898 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-57856e0f-54b1-4ba3-a7f3-b7c0f709980a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:23.657502 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-57856e0f-54b1-4ba3-a7f3-b7c0f709980a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:23.658354 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-57856e0f-54b1-4ba3-a7f3-b7c0f709980a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:23.659594 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-57856e0f-54b1-4ba3-a7f3-b7c0f709980a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:23.660254 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-57856e0f-54b1-4ba3-a7f3-b7c0f709980a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:23.775201 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-57856e0f-54b1-4ba3-a7f3-b7c0f709980a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:23.806222 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-57856e0f-54b1-4ba3-a7f3-b7c0f709980a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1277 microversion: 2.1 time: 0.171240 Jan 19 16:04:23.809478 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-74e3ecec-be13-4dbe-86aa-34bc04c66e26 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:23.820809 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-74e3ecec-be13-4dbe-86aa-34bc04c66e26 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:23.821222 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 181/359] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:23 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:23.821639 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-74e3ecec-be13-4dbe-86aa-34bc04c66e26 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:23.822274 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-74e3ecec-be13-4dbe-86aa-34bc04c66e26 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:23.823333 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-74e3ecec-be13-4dbe-86aa-34bc04c66e26 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:23.824181 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-74e3ecec-be13-4dbe-86aa-34bc04c66e26 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:23.868081 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-133babd7-3698-4e75-a4a0-db1d27e81410 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:23.869355 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-133babd7-3698-4e75-a4a0-db1d27e81410 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:23.884300 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-133babd7-3698-4e75-a4a0-db1d27e81410 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:23.884941 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-133babd7-3698-4e75-a4a0-db1d27e81410 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:23.885854 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-133babd7-3698-4e75-a4a0-db1d27e81410 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:23.886574 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-133babd7-3698-4e75-a4a0-db1d27e81410 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:23.968585 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-133babd7-3698-4e75-a4a0-db1d27e81410 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.103200 Jan 19 16:04:23.970499 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 182/360] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:23 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:04:24.293293 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-74e3ecec-be13-4dbe-86aa-34bc04c66e26 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:24.318620 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-74e3ecec-be13-4dbe-86aa-34bc04c66e26 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1519 microversion: 2.1 time: 0.514023 Jan 19 16:04:24.321631 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 179/361] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:23 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1519 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:24.524228 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-59d0d7f1-e65d-4e54-996d-5d8a96dae7be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:24.525178 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-59d0d7f1-e65d-4e54-996d-5d8a96dae7be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:24.545979 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-59d0d7f1-e65d-4e54-996d-5d8a96dae7be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:24.546432 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-59d0d7f1-e65d-4e54-996d-5d8a96dae7be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:24.547312 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-59d0d7f1-e65d-4e54-996d-5d8a96dae7be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:24.547903 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-59d0d7f1-e65d-4e54-996d-5d8a96dae7be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:24.647237 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-59d0d7f1-e65d-4e54-996d-5d8a96dae7be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.126958 Jan 19 16:04:24.648406 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 183/362] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:24 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:24.826124 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e26c6c15-6751-474e-ba7a-08438930a54c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:24.830109 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-e26c6c15-6751-474e-ba7a-08438930a54c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:24.834017 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e26c6c15-6751-474e-ba7a-08438930a54c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:24.834455 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e26c6c15-6751-474e-ba7a-08438930a54c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:24.835302 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e26c6c15-6751-474e-ba7a-08438930a54c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:24.835724 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e26c6c15-6751-474e-ba7a-08438930a54c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:24.901316 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e26c6c15-6751-474e-ba7a-08438930a54c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:24.909767 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e26c6c15-6751-474e-ba7a-08438930a54c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1275 microversion: 2.1 time: 0.087739 Jan 19 16:04:24.919695 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 180/363] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:24 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1275 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:24.982564 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-2cf4856b-6eb2-42da-b667-200c7084be7d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:24.983808 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-2cf4856b-6eb2-42da-b667-200c7084be7d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:24.997324 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2cf4856b-6eb2-42da-b667-200c7084be7d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:25.002937 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2cf4856b-6eb2-42da-b667-200c7084be7d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:25.006109 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2cf4856b-6eb2-42da-b667-200c7084be7d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:25.006650 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2cf4856b-6eb2-42da-b667-200c7084be7d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:25.118337 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-2cf4856b-6eb2-42da-b667-200c7084be7d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.140068 Jan 19 16:04:25.119051 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 184/364] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:24 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:25.350727 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-95343af7-0427-4961-bf26-4b573a2a8288 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:25.352562 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-95343af7-0427-4961-bf26-4b573a2a8288 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:25.365661 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-95343af7-0427-4961-bf26-4b573a2a8288 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:25.366078 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-95343af7-0427-4961-bf26-4b573a2a8288 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:25.366989 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-95343af7-0427-4961-bf26-4b573a2a8288 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:25.375894 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-95343af7-0427-4961-bf26-4b573a2a8288 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:25.661567 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-95343af7-0427-4961-bf26-4b573a2a8288 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:25.671638 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-95343af7-0427-4961-bf26-4b573a2a8288 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1519 microversion: 2.1 time: 0.322837 Jan 19 16:04:25.687689 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 181/365] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:25 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1519 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:25.687998 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-635cbb7c-95e0-49a0-9625-4ae7383b5018 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:25.687998 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-635cbb7c-95e0-49a0-9625-4ae7383b5018 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:25.689271 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-635cbb7c-95e0-49a0-9625-4ae7383b5018 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:25.690317 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-635cbb7c-95e0-49a0-9625-4ae7383b5018 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:25.692035 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-635cbb7c-95e0-49a0-9625-4ae7383b5018 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:25.694082 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-635cbb7c-95e0-49a0-9625-4ae7383b5018 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:25.860848 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-635cbb7c-95e0-49a0-9625-4ae7383b5018 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.201887 Jan 19 16:04:25.863022 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 185/366] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:25 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:25.935313 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-19775c4a-3a45-48b3-8cd1-dfd75b44c9c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:25.936606 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-19775c4a-3a45-48b3-8cd1-dfd75b44c9c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:25.947856 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-19775c4a-3a45-48b3-8cd1-dfd75b44c9c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:25.948735 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-19775c4a-3a45-48b3-8cd1-dfd75b44c9c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:25.950198 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-19775c4a-3a45-48b3-8cd1-dfd75b44c9c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:25.950998 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-19775c4a-3a45-48b3-8cd1-dfd75b44c9c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:26.133526 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-860c9e38-d856-44c9-9c50-98dcce37e251 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:26.135088 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-860c9e38-d856-44c9-9c50-98dcce37e251 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:26.145261 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-860c9e38-d856-44c9-9c50-98dcce37e251 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:26.146108 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-860c9e38-d856-44c9-9c50-98dcce37e251 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:26.147484 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-860c9e38-d856-44c9-9c50-98dcce37e251 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:26.148474 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-860c9e38-d856-44c9-9c50-98dcce37e251 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:26.257158 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-860c9e38-d856-44c9-9c50-98dcce37e251 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.129478 Jan 19 16:04:26.262410 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 186/367] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:26 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:04:26.284755 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-19775c4a-3a45-48b3-8cd1-dfd75b44c9c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:26.292962 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-19775c4a-3a45-48b3-8cd1-dfd75b44c9c6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1317 microversion: 2.1 time: 0.368845 Jan 19 16:04:26.293560 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 182/368] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:25 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:26.667455 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-bfb735e2-575a-4573-b08f-9a895e9b88c1 req-79ac15da-b92c-4184-911e-59d2e816d40b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad149c5f-bf90-41d8-b480-18b9dafbd058", "tag": "cb6c185c-94b9-4994-9bb2-8b68be5d0408"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:26.682226 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:04:26.682226 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:04:26.703727 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-0d7791c4-1362-402d-81c7-33be3ce90146 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:26.707324 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-0d7791c4-1362-402d-81c7-33be3ce90146 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:26.718096 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-bfb735e2-575a-4573-b08f-9a895e9b88c1 req-79ac15da-b92c-4184-911e-59d2e816d40b service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:26.719845 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-bfb735e2-575a-4573-b08f-9a895e9b88c1 req-79ac15da-b92c-4184-911e-59d2e816d40b service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:26.755947 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0d7791c4-1362-402d-81c7-33be3ce90146 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:26.757242 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0d7791c4-1362-402d-81c7-33be3ce90146 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:26.759334 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0d7791c4-1362-402d-81c7-33be3ce90146 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:26.760493 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0d7791c4-1362-402d-81c7-33be3ce90146 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:26.769166 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-bfb735e2-575a-4573-b08f-9a895e9b88c1 req-79ac15da-b92c-4184-911e-59d2e816d40b service nova] Creating event network-changed:cb6c185c-94b9-4994-9bb2-8b68be5d0408 for instance ad149c5f-bf90-41d8-b480-18b9dafbd058 on hv-cinder-82002 Jan 19 16:04:26.808799 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-bfb735e2-575a-4573-b08f-9a895e9b88c1 req-79ac15da-b92c-4184-911e-59d2e816d40b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147922 Jan 19 16:04:26.814086 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 187/369] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:04:26.874885 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-60722b61-df07-46c0-9e56-0efa17a2c817 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:26.876267 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-60722b61-df07-46c0-9e56-0efa17a2c817 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:26.899598 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-60722b61-df07-46c0-9e56-0efa17a2c817 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:26.903024 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-60722b61-df07-46c0-9e56-0efa17a2c817 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:26.907502 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-60722b61-df07-46c0-9e56-0efa17a2c817 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:26.912160 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-60722b61-df07-46c0-9e56-0efa17a2c817 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:27.004225 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-60722b61-df07-46c0-9e56-0efa17a2c817 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.131754 Jan 19 16:04:27.007201 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 188/370] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:26 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:27.016763 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c251193e-808b-48c9-98de-dc7aaf92f00e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2140502290", "imageRef": "6d9c05bd-015a-44de-bd51-f744cb247e7a", "flavorRef": "452", "networks": [{"uuid": "165e0cd2-7a89-43fa-bef6-46f81611384f"}]}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:27.097001 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.network.neutron [None req-c251193e-808b-48c9-98de-dc7aaf92f00e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] validate_networks() for [('165e0cd2-7a89-43fa-bef6-46f81611384f', None, None, None, None, None)] {{(pid=128876) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:04:27.296443 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-0d7791c4-1362-402d-81c7-33be3ce90146 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:27.327645 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-0d7791c4-1362-402d-81c7-33be3ce90146 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1519 microversion: 2.1 time: 0.635214 Jan 19 16:04:27.338103 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 183/371] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:26 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1519 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:27.338103 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-0e9be272-fa39-4bbd-8544-a91bb361db96 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1996707006", "imageRef": "6d9c05bd-015a-44de-bd51-f744cb247e7a", "flavorRef": "452", "networks": [{"uuid": "1b436032-e8e9-486b-8f5b-70682e8ec306"}]}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:27.432762 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.network.neutron [None req-0e9be272-fa39-4bbd-8544-a91bb361db96 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] validate_networks() for [('1b436032-e8e9-486b-8f5b-70682e8ec306', None, None, None, None, None)] {{(pid=128875) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:04:27.560419 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-c251193e-808b-48c9-98de-dc7aaf92f00e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Flavor limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:04:27.561106 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-c251193e-808b-48c9-98de-dc7aaf92f00e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Image limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:04:27.561570 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-c251193e-808b-48c9-98de-dc7aaf92f00e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Flavor pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:04:27.562186 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-c251193e-808b-48c9-98de-dc7aaf92f00e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Image pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:04:27.562356 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-c251193e-808b-48c9-98de-dc7aaf92f00e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:04:27.578186 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c251193e-808b-48c9-98de-dc7aaf92f00e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:27.579216 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c251193e-808b-48c9-98de-dc7aaf92f00e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:27.580025 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c251193e-808b-48c9-98de-dc7aaf92f00e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:27.580700 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c251193e-808b-48c9-98de-dc7aaf92f00e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:27.599290 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-c251193e-808b-48c9-98de-dc7aaf92f00e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Getting quotas for project 32d0fa3bcd1c4abda9016798b037bf1f. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:04:27.611507 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-c251193e-808b-48c9-98de-dc7aaf92f00e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Getting quotas for user 80c9613f79684051a2f0465852b5bfed and project 32d0fa3bcd1c4abda9016798b037bf1f. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:04:27.630894 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c251193e-808b-48c9-98de-dc7aaf92f00e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Going to run 1 instances... {{(pid=128876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:04:27.633455 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c251193e-808b-48c9-98de-dc7aaf92f00e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6d9c05bd-015a-44de-bd51-f744cb247e7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:04:27.847078 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c251193e-808b-48c9-98de-dc7aaf92f00e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.837447 Jan 19 16:04:27.847769 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 189/372] 10.222.0.58 () {60 vars in 1146 bytes} [Wed Jan 19 16:04:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:04:27.854529 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-898f8a66-0615-4597-85f1-a5c650fbecb1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:27.861167 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-898f8a66-0615-4597-85f1-a5c650fbecb1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:27.869697 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-898f8a66-0615-4597-85f1-a5c650fbecb1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:27.876367 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-898f8a66-0615-4597-85f1-a5c650fbecb1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:27.877838 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-898f8a66-0615-4597-85f1-a5c650fbecb1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:27.878352 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-898f8a66-0615-4597-85f1-a5c650fbecb1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:27.967175 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-898f8a66-0615-4597-85f1-a5c650fbecb1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.115993 Jan 19 16:04:27.969664 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 190/373] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:27 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:27.976587 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e97a13ec-bf39-43c9-90a2-9c4fddd44592 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:27.977404 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-e97a13ec-bf39-43c9-90a2-9c4fddd44592 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:27.990934 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e97a13ec-bf39-43c9-90a2-9c4fddd44592 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:27.992410 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e97a13ec-bf39-43c9-90a2-9c4fddd44592 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:27.994570 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e97a13ec-bf39-43c9-90a2-9c4fddd44592 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:27.995466 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e97a13ec-bf39-43c9-90a2-9c4fddd44592 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:28.217336 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e97a13ec-bf39-43c9-90a2-9c4fddd44592 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:28.226439 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e97a13ec-bf39-43c9-90a2-9c4fddd44592 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1317 microversion: 2.1 time: 0.254566 Jan 19 16:04:28.228063 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 191/374] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:27 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:28.239025 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-070ead93-9274-4429-b960-39ae28f39f82 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:28.239025 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-070ead93-9274-4429-b960-39ae28f39f82 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:28.344503 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-070ead93-9274-4429-b960-39ae28f39f82 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:28.352433 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-070ead93-9274-4429-b960-39ae28f39f82 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc" status: 200 len: 1214 microversion: 2.1 time: 0.122498 Jan 19 16:04:28.353317 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 192/375] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:28 2022] GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc => generated 1214 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:28.374015 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b974c901-74bb-4671-b08a-7de0347f0c68 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:28.375052 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b974c901-74bb-4671-b08a-7de0347f0c68 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:28.389693 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b974c901-74bb-4671-b08a-7de0347f0c68 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:28.390467 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b974c901-74bb-4671-b08a-7de0347f0c68 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:28.391443 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b974c901-74bb-4671-b08a-7de0347f0c68 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:28.391904 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b974c901-74bb-4671-b08a-7de0347f0c68 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:28.394752 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-0e9be272-fa39-4bbd-8544-a91bb361db96 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Flavor limits 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:04:28.395666 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-0e9be272-fa39-4bbd-8544-a91bb361db96 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Image limits 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:04:28.398172 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-0e9be272-fa39-4bbd-8544-a91bb361db96 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Flavor pref 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:04:28.398172 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-0e9be272-fa39-4bbd-8544-a91bb361db96 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Image pref 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:04:28.398172 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-0e9be272-fa39-4bbd-8544-a91bb361db96 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:04:28.424673 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0e9be272-fa39-4bbd-8544-a91bb361db96 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:28.427156 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0e9be272-fa39-4bbd-8544-a91bb361db96 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:28.430628 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0e9be272-fa39-4bbd-8544-a91bb361db96 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:28.431578 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0e9be272-fa39-4bbd-8544-a91bb361db96 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:28.464177 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-0e9be272-fa39-4bbd-8544-a91bb361db96 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Getting quotas for project 1c338a65c4354429b3e8afe68e5a754d. Resources: {'ram', 'cores', 'instances'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:04:28.472678 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-0e9be272-fa39-4bbd-8544-a91bb361db96 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Getting quotas for user 1d4be467c547439aa51edb2b18d2f906 and project 1c338a65c4354429b3e8afe68e5a754d. Resources: {'ram', 'cores', 'instances'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:04:28.491686 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b974c901-74bb-4671-b08a-7de0347f0c68 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.110989 Jan 19 16:04:28.491686 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 193/376] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:28 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:28.498727 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-0e9be272-fa39-4bbd-8544-a91bb361db96 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Going to run 1 instances... {{(pid=128875) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:04:28.499312 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-28db3655-9ab8-4ee1-a1b8-4fc958e3d5ae tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:28.500310 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-28db3655-9ab8-4ee1-a1b8-4fc958e3d5ae tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:28.503206 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-0e9be272-fa39-4bbd-8544-a91bb361db96 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6d9c05bd-015a-44de-bd51-f744cb247e7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:04:28.509482 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-28db3655-9ab8-4ee1-a1b8-4fc958e3d5ae tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:28.510019 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-28db3655-9ab8-4ee1-a1b8-4fc958e3d5ae tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:28.510745 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-28db3655-9ab8-4ee1-a1b8-4fc958e3d5ae tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:28.511221 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-28db3655-9ab8-4ee1-a1b8-4fc958e3d5ae tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:28.646868 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-0e9be272-fa39-4bbd-8544-a91bb361db96 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.316542 Jan 19 16:04:28.647589 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 184/377] 10.222.0.58 () {60 vars in 1146 bytes} [Wed Jan 19 16:04:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:04:28.661537 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-210426f8-5cd4-40d4-9624-9f042801fdd9 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:28.662535 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-210426f8-5cd4-40d4-9624-9f042801fdd9 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:28.813075 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-210426f8-5cd4-40d4-9624-9f042801fdd9 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:28.821143 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-28db3655-9ab8-4ee1-a1b8-4fc958e3d5ae tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:28.830818 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-210426f8-5cd4-40d4-9624-9f042801fdd9 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9" status: 200 len: 1219 microversion: 2.1 time: 0.172839 Jan 19 16:04:28.831464 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 185/378] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:28 2022] GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9 => generated 1219 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:28.852692 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-28db3655-9ab8-4ee1-a1b8-4fc958e3d5ae tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1519 microversion: 2.1 time: 0.358924 Jan 19 16:04:28.853877 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 194/379] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:28 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1519 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:28.982776 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-7fe59ec3-1b79-4ecc-8118-990018cf8b48 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:28.984247 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-7fe59ec3-1b79-4ecc-8118-990018cf8b48 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:28.992155 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7fe59ec3-1b79-4ecc-8118-990018cf8b48 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:28.992602 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7fe59ec3-1b79-4ecc-8118-990018cf8b48 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:28.993411 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7fe59ec3-1b79-4ecc-8118-990018cf8b48 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:28.993848 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7fe59ec3-1b79-4ecc-8118-990018cf8b48 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:29.169248 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-7fe59ec3-1b79-4ecc-8118-990018cf8b48 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.191956 Jan 19 16:04:29.169914 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 186/380] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:28 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:29.249089 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f75aed83-159b-4baf-b59f-a895d7787bab tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:29.249614 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f75aed83-159b-4baf-b59f-a895d7787bab tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:29.256903 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f75aed83-159b-4baf-b59f-a895d7787bab tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:29.257341 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f75aed83-159b-4baf-b59f-a895d7787bab tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:29.258137 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f75aed83-159b-4baf-b59f-a895d7787bab tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:29.258574 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f75aed83-159b-4baf-b59f-a895d7787bab tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:29.370546 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-af38ccd6-c7b6-489d-961b-c576a7f7847c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:29.371299 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-af38ccd6-c7b6-489d-961b-c576a7f7847c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:29.432606 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f75aed83-159b-4baf-b59f-a895d7787bab tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:29.439628 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-af38ccd6-c7b6-489d-961b-c576a7f7847c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:29.442131 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f75aed83-159b-4baf-b59f-a895d7787bab tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1317 microversion: 2.1 time: 0.196568 Jan 19 16:04:29.447408 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-af38ccd6-c7b6-489d-961b-c576a7f7847c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc" status: 200 len: 1214 microversion: 2.1 time: 0.081021 Jan 19 16:04:29.448602 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 187/381] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:29 2022] GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:29.451369 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 195/382] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:29 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:29.500891 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-2d9fb730-42f6-4880-9682-e7174adfa60f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:29.501719 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-2d9fb730-42f6-4880-9682-e7174adfa60f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:29.508711 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2d9fb730-42f6-4880-9682-e7174adfa60f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:29.509131 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2d9fb730-42f6-4880-9682-e7174adfa60f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:29.509938 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2d9fb730-42f6-4880-9682-e7174adfa60f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:29.510392 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2d9fb730-42f6-4880-9682-e7174adfa60f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:29.697468 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-2d9fb730-42f6-4880-9682-e7174adfa60f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.200862 Jan 19 16:04:29.698228 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 188/383] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:29 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:29.856908 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-7483c5cd-c05f-4d64-b5e4-47ce1c8ddc9d tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:29.857643 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-7483c5cd-c05f-4d64-b5e4-47ce1c8ddc9d tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:29.871401 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-81fcf793-bd28-4993-bfe7-a45b81e78cff tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:29.872092 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-81fcf793-bd28-4993-bfe7-a45b81e78cff tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:29.879431 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-81fcf793-bd28-4993-bfe7-a45b81e78cff tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:29.879869 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-81fcf793-bd28-4993-bfe7-a45b81e78cff tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:29.880692 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-81fcf793-bd28-4993-bfe7-a45b81e78cff tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:29.881119 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-81fcf793-bd28-4993-bfe7-a45b81e78cff tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:29.925023 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-7483c5cd-c05f-4d64-b5e4-47ce1c8ddc9d tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:29.937027 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-7483c5cd-c05f-4d64-b5e4-47ce1c8ddc9d tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9" status: 200 len: 1219 microversion: 2.1 time: 0.082850 Jan 19 16:04:29.938252 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 196/384] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:29 2022] GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:30.080382 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-81fcf793-bd28-4993-bfe7-a45b81e78cff tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:30.089159 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-81fcf793-bd28-4993-bfe7-a45b81e78cff tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1519 microversion: 2.1 time: 0.221598 Jan 19 16:04:30.089918 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 189/385] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:29 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1519 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:30.181822 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-15cd527e-87e6-4ec0-b4bd-7194a74f4fb6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:30.182948 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-15cd527e-87e6-4ec0-b4bd-7194a74f4fb6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:30.192810 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-15cd527e-87e6-4ec0-b4bd-7194a74f4fb6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:30.193303 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-15cd527e-87e6-4ec0-b4bd-7194a74f4fb6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:30.194264 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-15cd527e-87e6-4ec0-b4bd-7194a74f4fb6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:30.194744 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-15cd527e-87e6-4ec0-b4bd-7194a74f4fb6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:30.274382 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-15cd527e-87e6-4ec0-b4bd-7194a74f4fb6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.095937 Jan 19 16:04:30.275485 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 197/386] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:30 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:04:30.463715 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-65bfcbc1-ae8a-4eb9-9990-d34404cf85b2 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:30.464580 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-65bfcbc1-ae8a-4eb9-9990-d34404cf85b2 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:30.470624 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8d6f9ffa-6a8f-46f6-8486-03d56274b36f tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:30.472329 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-8d6f9ffa-6a8f-46f6-8486-03d56274b36f tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:30.472886 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-65bfcbc1-ae8a-4eb9-9990-d34404cf85b2 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:30.473400 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-65bfcbc1-ae8a-4eb9-9990-d34404cf85b2 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:30.474361 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-65bfcbc1-ae8a-4eb9-9990-d34404cf85b2 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:30.474952 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-65bfcbc1-ae8a-4eb9-9990-d34404cf85b2 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:30.483868 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8d6f9ffa-6a8f-46f6-8486-03d56274b36f tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:30.486860 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8d6f9ffa-6a8f-46f6-8486-03d56274b36f tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:30.486860 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8d6f9ffa-6a8f-46f6-8486-03d56274b36f tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:30.486860 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8d6f9ffa-6a8f-46f6-8486-03d56274b36f tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:30.568233 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8d6f9ffa-6a8f-46f6-8486-03d56274b36f tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:30.579924 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-8d6f9ffa-6a8f-46f6-8486-03d56274b36f tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc" status: 200 len: 1266 microversion: 2.1 time: 0.118141 Jan 19 16:04:30.581036 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 198/387] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:30 2022] GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc => generated 1266 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:30.650871 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-65bfcbc1-ae8a-4eb9-9990-d34404cf85b2 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:30.664635 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-65bfcbc1-ae8a-4eb9-9990-d34404cf85b2 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1317 microversion: 2.1 time: 0.206336 Jan 19 16:04:30.665957 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 190/388] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:30 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:30.710786 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ae118f35-4bbd-4bc5-840f-16e4961cc91c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:30.711743 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ae118f35-4bbd-4bc5-840f-16e4961cc91c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:30.718179 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ae118f35-4bbd-4bc5-840f-16e4961cc91c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:30.727669 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ae118f35-4bbd-4bc5-840f-16e4961cc91c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:30.727669 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ae118f35-4bbd-4bc5-840f-16e4961cc91c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:30.727669 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ae118f35-4bbd-4bc5-840f-16e4961cc91c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:30.812981 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ae118f35-4bbd-4bc5-840f-16e4961cc91c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.105668 Jan 19 16:04:30.814067 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 199/389] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:30 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:30.953986 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-4708d3b6-afc2-44a6-ac71-931189525b36 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:30.954842 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-4708d3b6-afc2-44a6-ac71-931189525b36 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:30.961272 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4708d3b6-afc2-44a6-ac71-931189525b36 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:30.961717 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4708d3b6-afc2-44a6-ac71-931189525b36 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:30.962505 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4708d3b6-afc2-44a6-ac71-931189525b36 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:30.962944 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4708d3b6-afc2-44a6-ac71-931189525b36 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:31.035894 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-4708d3b6-afc2-44a6-ac71-931189525b36 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:31.046263 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-4708d3b6-afc2-44a6-ac71-931189525b36 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9" status: 200 len: 1271 microversion: 2.1 time: 0.096346 Jan 19 16:04:31.047824 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 191/390] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:30 2022] GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9 => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:31.112035 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-58a7b929-63cc-4011-bd1f-b96d94394d3f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:31.117995 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-58a7b929-63cc-4011-bd1f-b96d94394d3f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:31.122529 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-58a7b929-63cc-4011-bd1f-b96d94394d3f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:31.123333 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-58a7b929-63cc-4011-bd1f-b96d94394d3f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:31.124470 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-58a7b929-63cc-4011-bd1f-b96d94394d3f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:31.125188 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-58a7b929-63cc-4011-bd1f-b96d94394d3f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:31.290328 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-180bdabc-ad98-42de-ad00-851b1ceadf69 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:31.291360 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-180bdabc-ad98-42de-ad00-851b1ceadf69 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:31.307823 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-180bdabc-ad98-42de-ad00-851b1ceadf69 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:31.307823 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-180bdabc-ad98-42de-ad00-851b1ceadf69 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:31.307823 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-180bdabc-ad98-42de-ad00-851b1ceadf69 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:31.307823 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-180bdabc-ad98-42de-ad00-851b1ceadf69 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:31.368540 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-58a7b929-63cc-4011-bd1f-b96d94394d3f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:31.382510 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-58a7b929-63cc-4011-bd1f-b96d94394d3f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1519 microversion: 2.1 time: 0.276908 Jan 19 16:04:31.383563 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 200/391] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:31 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1519 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:31.451140 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-180bdabc-ad98-42de-ad00-851b1ceadf69 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.166026 Jan 19 16:04:31.452824 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 192/392] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:31 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:31.598691 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-25859f7f-bf42-49a4-bcbe-497dfea257ad tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:31.599053 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-25859f7f-bf42-49a4-bcbe-497dfea257ad tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:31.606212 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-25859f7f-bf42-49a4-bcbe-497dfea257ad tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:31.607028 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-25859f7f-bf42-49a4-bcbe-497dfea257ad tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:31.610901 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-25859f7f-bf42-49a4-bcbe-497dfea257ad tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:31.610901 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-25859f7f-bf42-49a4-bcbe-497dfea257ad tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:31.677931 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-25859f7f-bf42-49a4-bcbe-497dfea257ad tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:31.684296 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-4afe2d7b-7867-4e15-b9e6-2bd96b536dc6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:31.686214 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-4afe2d7b-7867-4e15-b9e6-2bd96b536dc6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:31.691063 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-25859f7f-bf42-49a4-bcbe-497dfea257ad tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc" status: 200 len: 1272 microversion: 2.1 time: 0.096451 Jan 19 16:04:31.692113 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 201/393] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:31 2022] GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc => generated 1272 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:31.695450 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4afe2d7b-7867-4e15-b9e6-2bd96b536dc6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:31.696073 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4afe2d7b-7867-4e15-b9e6-2bd96b536dc6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:31.696995 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4afe2d7b-7867-4e15-b9e6-2bd96b536dc6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:31.697536 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4afe2d7b-7867-4e15-b9e6-2bd96b536dc6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:31.826497 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-67404248-58fe-4950-ac7f-dab397ba53a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:31.827354 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-67404248-58fe-4950-ac7f-dab397ba53a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:31.841793 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-67404248-58fe-4950-ac7f-dab397ba53a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:31.848947 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-67404248-58fe-4950-ac7f-dab397ba53a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:31.848947 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-67404248-58fe-4950-ac7f-dab397ba53a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:31.848947 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-67404248-58fe-4950-ac7f-dab397ba53a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:31.954334 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-67404248-58fe-4950-ac7f-dab397ba53a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.131672 Jan 19 16:04:31.955299 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 202/394] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:31 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:04:32.080650 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-300afe0a-acc7-4720-8cdf-3f7fc4c87c57 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:32.081913 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-300afe0a-acc7-4720-8cdf-3f7fc4c87c57 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:32.102295 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-300afe0a-acc7-4720-8cdf-3f7fc4c87c57 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:32.102597 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-300afe0a-acc7-4720-8cdf-3f7fc4c87c57 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:32.104012 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-300afe0a-acc7-4720-8cdf-3f7fc4c87c57 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:32.104799 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-300afe0a-acc7-4720-8cdf-3f7fc4c87c57 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:32.190547 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-300afe0a-acc7-4720-8cdf-3f7fc4c87c57 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:32.199374 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-300afe0a-acc7-4720-8cdf-3f7fc4c87c57 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9" status: 200 len: 1279 microversion: 2.1 time: 0.126065 Jan 19 16:04:32.199737 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 203/395] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:32 2022] GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9 => generated 1279 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:32.321570 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-4afe2d7b-7867-4e15-b9e6-2bd96b536dc6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:32.339728 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-4afe2d7b-7867-4e15-b9e6-2bd96b536dc6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1317 microversion: 2.1 time: 0.653116 Jan 19 16:04:32.339728 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 193/396] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:31 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1317 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:32.402337 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-89444a39-6045-490d-9828-9e5feedcdf3a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:32.402960 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-89444a39-6045-490d-9828-9e5feedcdf3a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:32.409848 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-89444a39-6045-490d-9828-9e5feedcdf3a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:32.410296 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-89444a39-6045-490d-9828-9e5feedcdf3a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:32.411112 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-89444a39-6045-490d-9828-9e5feedcdf3a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:32.411551 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-89444a39-6045-490d-9828-9e5feedcdf3a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:32.468846 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c1d22f01-0b0f-4b45-a7be-54b3acf5f615 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:32.470293 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c1d22f01-0b0f-4b45-a7be-54b3acf5f615 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:32.480021 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c1d22f01-0b0f-4b45-a7be-54b3acf5f615 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:32.480575 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c1d22f01-0b0f-4b45-a7be-54b3acf5f615 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:32.481426 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c1d22f01-0b0f-4b45-a7be-54b3acf5f615 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:32.482107 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c1d22f01-0b0f-4b45-a7be-54b3acf5f615 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:32.647947 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-89444a39-6045-490d-9828-9e5feedcdf3a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:32.655793 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-89444a39-6045-490d-9828-9e5feedcdf3a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1519 microversion: 2.1 time: 0.257585 Jan 19 16:04:32.656419 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 204/397] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:32 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1519 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:32.682309 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c1d22f01-0b0f-4b45-a7be-54b3acf5f615 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.221070 Jan 19 16:04:32.682962 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 194/398] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:32 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:04:32.709406 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8db4b9b2-4a20-4a18-ab2a-a4d26b2a4421 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:32.710011 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-8db4b9b2-4a20-4a18-ab2a-a4d26b2a4421 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:32.716760 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8db4b9b2-4a20-4a18-ab2a-a4d26b2a4421 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:32.717197 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8db4b9b2-4a20-4a18-ab2a-a4d26b2a4421 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:32.717994 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8db4b9b2-4a20-4a18-ab2a-a4d26b2a4421 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:32.718421 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8db4b9b2-4a20-4a18-ab2a-a4d26b2a4421 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:32.898406 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8db4b9b2-4a20-4a18-ab2a-a4d26b2a4421 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:32.913138 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-8db4b9b2-4a20-4a18-ab2a-a4d26b2a4421 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc" status: 200 len: 1314 microversion: 2.1 time: 0.206969 Jan 19 16:04:32.914464 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 205/399] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:32 2022] GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:32.967697 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e3ab0a29-adae-49ea-aa73-0bb9c87bf04a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:32.969519 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-e3ab0a29-adae-49ea-aa73-0bb9c87bf04a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:32.988404 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e3ab0a29-adae-49ea-aa73-0bb9c87bf04a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:32.988928 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e3ab0a29-adae-49ea-aa73-0bb9c87bf04a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:32.990351 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e3ab0a29-adae-49ea-aa73-0bb9c87bf04a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:32.990795 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e3ab0a29-adae-49ea-aa73-0bb9c87bf04a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:33.081281 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e3ab0a29-adae-49ea-aa73-0bb9c87bf04a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.117406 Jan 19 16:04:33.082773 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 195/400] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:32 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:33.227030 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-1e5c0988-899f-4a43-868c-b272272f1fbe tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:33.228330 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-1e5c0988-899f-4a43-868c-b272272f1fbe tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:33.234950 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1e5c0988-899f-4a43-868c-b272272f1fbe tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:33.235469 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1e5c0988-899f-4a43-868c-b272272f1fbe tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:33.236307 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1e5c0988-899f-4a43-868c-b272272f1fbe tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:33.236741 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1e5c0988-899f-4a43-868c-b272272f1fbe tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:33.324807 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-1e5c0988-899f-4a43-868c-b272272f1fbe tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:33.335630 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-1e5c0988-899f-4a43-868c-b272272f1fbe tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9" status: 200 len: 1277 microversion: 2.1 time: 0.114377 Jan 19 16:04:33.336213 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 206/401] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:33 2022] GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9 => generated 1277 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:33.350035 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e58f8502-8a54-4c97-8604-4091959a3d0b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:33.350738 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-e58f8502-8a54-4c97-8604-4091959a3d0b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:33.358161 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e58f8502-8a54-4c97-8604-4091959a3d0b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:33.358602 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e58f8502-8a54-4c97-8604-4091959a3d0b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:33.359476 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e58f8502-8a54-4c97-8604-4091959a3d0b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:33.359905 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e58f8502-8a54-4c97-8604-4091959a3d0b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:33.673852 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-afe10074-4bcf-41c1-aa2b-101fb2da4716 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:33.674581 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-afe10074-4bcf-41c1-aa2b-101fb2da4716 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:33.681360 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-afe10074-4bcf-41c1-aa2b-101fb2da4716 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:33.681814 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-afe10074-4bcf-41c1-aa2b-101fb2da4716 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:33.682624 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-afe10074-4bcf-41c1-aa2b-101fb2da4716 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:33.683302 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-afe10074-4bcf-41c1-aa2b-101fb2da4716 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:33.739187 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e58f8502-8a54-4c97-8604-4091959a3d0b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:33.754299 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e58f8502-8a54-4c97-8604-4091959a3d0b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1317 microversion: 2.1 time: 0.408369 Jan 19 16:04:33.754924 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 196/402] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:33 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1317 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:33.765713 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-75fac848-dee8-4b6b-b79c-5f02360c8150 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:33.768533 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-75fac848-dee8-4b6b-b79c-5f02360c8150 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:33.783202 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-75fac848-dee8-4b6b-b79c-5f02360c8150 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:33.791237 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-75fac848-dee8-4b6b-b79c-5f02360c8150 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:33.792122 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-75fac848-dee8-4b6b-b79c-5f02360c8150 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:33.792564 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-75fac848-dee8-4b6b-b79c-5f02360c8150 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:33.877738 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-75fac848-dee8-4b6b-b79c-5f02360c8150 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.120255 Jan 19 16:04:33.878310 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 197/403] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:33 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:33.921551 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-afe10074-4bcf-41c1-aa2b-101fb2da4716 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:33.933180 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-afe10074-4bcf-41c1-aa2b-101fb2da4716 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1499 microversion: 2.1 time: 0.263293 Jan 19 16:04:33.934064 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 207/404] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:33 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1499 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:33.958770 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6245497c-f243-4d46-9eea-e070733f2ac5 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:33.961866 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-6245497c-f243-4d46-9eea-e070733f2ac5 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:33.977506 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-569d16ba-c637-40b5-a4b9-8b2360bd23e1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7465a4c4-6faf-45f6-b513-5ee98c232cbf"}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:33.980286 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-569d16ba-c637-40b5-a4b9-8b2360bd23e1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:33.983060 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6245497c-f243-4d46-9eea-e070733f2ac5 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:33.987192 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6245497c-f243-4d46-9eea-e070733f2ac5 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:33.988768 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6245497c-f243-4d46-9eea-e070733f2ac5 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:33.989436 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6245497c-f243-4d46-9eea-e070733f2ac5 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:33.994524 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-569d16ba-c637-40b5-a4b9-8b2360bd23e1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:33.995445 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-569d16ba-c637-40b5-a4b9-8b2360bd23e1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:33.997675 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-569d16ba-c637-40b5-a4b9-8b2360bd23e1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:33.998326 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-569d16ba-c637-40b5-a4b9-8b2360bd23e1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:34.039374 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.wsgi [None req-569d16ba-c637-40b5-a4b9-8b2360bd23e1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] HTTP exception thrown: Cannot 'attach_volume' instance 808abc0b-bb27-496f-8ce0-d536ab3d1ffb while it is in vm_state rescued Jan 19 16:04:34.040166 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-569d16ba-c637-40b5-a4b9-8b2360bd23e1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Returning 409 to user: Cannot 'attach_volume' instance 808abc0b-bb27-496f-8ce0-d536ab3d1ffb while it is in vm_state rescued {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:04:34.042178 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-569d16ba-c637-40b5-a4b9-8b2360bd23e1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "POST /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.079390 Jan 19 16:04:34.047971 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 208/405] 10.222.0.58 () {60 vars in 1322 bytes} [Wed Jan 19 16:04:33 2022] POST /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments => generated 152 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jan 19 16:04:34.062471 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c7d655d7-a6ed-40db-bc34-e04e0e383b0f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:34.064268 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c7d655d7-a6ed-40db-bc34-e04e0e383b0f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:34.072065 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c7d655d7-a6ed-40db-bc34-e04e0e383b0f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:34.072807 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c7d655d7-a6ed-40db-bc34-e04e0e383b0f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:34.074045 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c7d655d7-a6ed-40db-bc34-e04e0e383b0f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:34.075880 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c7d655d7-a6ed-40db-bc34-e04e0e383b0f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:34.319055 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c7d655d7-a6ed-40db-bc34-e04e0e383b0f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "POST /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/action" status: 202 len: 0 microversion: 2.1 time: 0.261978 Jan 19 16:04:34.320208 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 209/406] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:34 2022] POST /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:34.330131 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-07509cdf-ea24-44c3-b79f-0b26c46b6e46 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:34.331983 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-07509cdf-ea24-44c3-b79f-0b26c46b6e46 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:34.343013 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-07509cdf-ea24-44c3-b79f-0b26c46b6e46 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:34.344301 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-07509cdf-ea24-44c3-b79f-0b26c46b6e46 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:34.345762 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-07509cdf-ea24-44c3-b79f-0b26c46b6e46 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:34.350425 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-07509cdf-ea24-44c3-b79f-0b26c46b6e46 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:34.447015 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-07509cdf-ea24-44c3-b79f-0b26c46b6e46 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.124312 Jan 19 16:04:34.459915 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 210/407] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:34 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:34.460182 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6245497c-f243-4d46-9eea-e070733f2ac5 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:34.469719 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-0dfc9e67-1859-47fb-a69a-26009edbcc41 req-0ed7a0c1-d80d-48ae-a9db-a7bc4ec8a646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8efdc25-ba11-4f86-8383-4bc10280edbc", "tag": "56d9765d-44b0-4cba-9c25-f5408ceb4492"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:34.471752 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:04:34.471752 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:04:34.486547 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-0dfc9e67-1859-47fb-a69a-26009edbcc41 req-0ed7a0c1-d80d-48ae-a9db-a7bc4ec8a646 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:34.487272 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-0dfc9e67-1859-47fb-a69a-26009edbcc41 req-0ed7a0c1-d80d-48ae-a9db-a7bc4ec8a646 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:34.494369 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6245497c-f243-4d46-9eea-e070733f2ac5 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc" status: 200 len: 1314 microversion: 2.1 time: 0.553043 Jan 19 16:04:34.497790 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 198/408] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:33 2022] GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:34.506261 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-380f2f2b-3444-4bf4-b3a8-863390da547b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:34.506879 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-380f2f2b-3444-4bf4-b3a8-863390da547b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:34.507175 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-0dfc9e67-1859-47fb-a69a-26009edbcc41 req-0ed7a0c1-d80d-48ae-a9db-a7bc4ec8a646 service nova] Creating event network-changed:56d9765d-44b0-4cba-9c25-f5408ceb4492 for instance c8efdc25-ba11-4f86-8383-4bc10280edbc on hv-cinder-82002 Jan 19 16:04:34.513768 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-380f2f2b-3444-4bf4-b3a8-863390da547b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:34.514546 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-380f2f2b-3444-4bf4-b3a8-863390da547b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:34.516803 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-0dfc9e67-1859-47fb-a69a-26009edbcc41 req-0ed7a0c1-d80d-48ae-a9db-a7bc4ec8a646 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058817 Jan 19 16:04:34.518070 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-380f2f2b-3444-4bf4-b3a8-863390da547b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:34.518200 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 211/409] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:04:34.518785 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-380f2f2b-3444-4bf4-b3a8-863390da547b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:34.536105 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-83d4f708-5170-42f4-a807-7f88e45457c7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:34.537002 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-83d4f708-5170-42f4-a807-7f88e45457c7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:34.546038 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-83d4f708-5170-42f4-a807-7f88e45457c7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:34.546772 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-83d4f708-5170-42f4-a807-7f88e45457c7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:34.548801 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-83d4f708-5170-42f4-a807-7f88e45457c7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:34.549520 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-83d4f708-5170-42f4-a807-7f88e45457c7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:34.756665 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-83d4f708-5170-42f4-a807-7f88e45457c7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:34.772545 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-83d4f708-5170-42f4-a807-7f88e45457c7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9" status: 200 len: 1319 microversion: 2.1 time: 0.243906 Jan 19 16:04:34.773171 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 212/410] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:34 2022] GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:34.778391 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-2aef5fd2-3f8f-4177-b1dd-1141d19a1480 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:34.782708 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-2aef5fd2-3f8f-4177-b1dd-1141d19a1480 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:34.786938 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2aef5fd2-3f8f-4177-b1dd-1141d19a1480 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:34.788091 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2aef5fd2-3f8f-4177-b1dd-1141d19a1480 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:34.789130 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2aef5fd2-3f8f-4177-b1dd-1141d19a1480 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:34.789605 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2aef5fd2-3f8f-4177-b1dd-1141d19a1480 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:34.838957 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-380f2f2b-3444-4bf4-b3a8-863390da547b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:34.852023 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-380f2f2b-3444-4bf4-b3a8-863390da547b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1507 microversion: 2.1 time: 0.352564 Jan 19 16:04:34.855002 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 199/411] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:34 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1507 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:34.893152 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ef6aee3b-b4dd-4849-83b4-ce06f15d2281 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:34.894425 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-ef6aee3b-b4dd-4849-83b4-ce06f15d2281 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:34.901662 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ef6aee3b-b4dd-4849-83b4-ce06f15d2281 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:34.902430 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ef6aee3b-b4dd-4849-83b4-ce06f15d2281 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:34.903467 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ef6aee3b-b4dd-4849-83b4-ce06f15d2281 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:34.903907 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ef6aee3b-b4dd-4849-83b4-ce06f15d2281 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:35.012265 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-2aef5fd2-3f8f-4177-b1dd-1141d19a1480 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:35.021708 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-2aef5fd2-3f8f-4177-b1dd-1141d19a1480 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1317 microversion: 2.1 time: 0.247404 Jan 19 16:04:35.022463 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 213/412] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:34 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:35.468030 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-66c0d94c-81cb-44d3-bb8a-a0a11c3305c5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:35.469027 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-66c0d94c-81cb-44d3-bb8a-a0a11c3305c5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:35.476133 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-66c0d94c-81cb-44d3-bb8a-a0a11c3305c5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:35.476572 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-66c0d94c-81cb-44d3-bb8a-a0a11c3305c5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:35.477358 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-66c0d94c-81cb-44d3-bb8a-a0a11c3305c5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:35.477787 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-66c0d94c-81cb-44d3-bb8a-a0a11c3305c5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:42.602133 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-ef6aee3b-b4dd-4849-83b4-ce06f15d2281 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 7.713833 Jan 19 16:04:42.603994 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 200/413] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:34 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 7718 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:04:42.615965 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-66c0d94c-81cb-44d3-bb8a-a0a11c3305c5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 7.149789 Jan 19 16:04:42.617109 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 214/414] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:35 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 7154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:04:42.618083 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6c020e0e-5fa4-499b-99fa-31a66c1c5927 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:42.620196 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-6c020e0e-5fa4-499b-99fa-31a66c1c5927 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:42.631528 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ad737064-af8d-4851-bafe-3f82bfd5ba5c tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:42.632844 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ad737064-af8d-4851-bafe-3f82bfd5ba5c tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:42.644647 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6c020e0e-5fa4-499b-99fa-31a66c1c5927 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:42.652217 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ad737064-af8d-4851-bafe-3f82bfd5ba5c tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:42.652827 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6c020e0e-5fa4-499b-99fa-31a66c1c5927 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:42.653002 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ad737064-af8d-4851-bafe-3f82bfd5ba5c tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:42.654310 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ad737064-af8d-4851-bafe-3f82bfd5ba5c tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:42.655098 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ad737064-af8d-4851-bafe-3f82bfd5ba5c tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:42.655977 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6c020e0e-5fa4-499b-99fa-31a66c1c5927 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:42.657208 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6c020e0e-5fa4-499b-99fa-31a66c1c5927 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:42.983561 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ad737064-af8d-4851-bafe-3f82bfd5ba5c tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:42.998605 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ad737064-af8d-4851-bafe-3f82bfd5ba5c tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9" status: 200 len: 1319 microversion: 2.1 time: 0.379129 Jan 19 16:04:42.999707 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 215/415] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:42 2022] GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9 => generated 1319 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:43.009220 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a7b18185-93d1-455c-8688-c7539d2e0e53 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:43.010095 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a7b18185-93d1-455c-8688-c7539d2e0e53 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:43.025520 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a7b18185-93d1-455c-8688-c7539d2e0e53 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:43.026338 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a7b18185-93d1-455c-8688-c7539d2e0e53 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:43.027865 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a7b18185-93d1-455c-8688-c7539d2e0e53 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:43.028686 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a7b18185-93d1-455c-8688-c7539d2e0e53 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:43.228632 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6c020e0e-5fa4-499b-99fa-31a66c1c5927 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:43.242685 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6c020e0e-5fa4-499b-99fa-31a66c1c5927 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc" status: 200 len: 1314 microversion: 2.1 time: 0.636072 Jan 19 16:04:43.244358 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 201/416] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:42 2022] GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc => generated 1314 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:43.255842 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-69ef4845-8758-44ea-95f4-cd4ed246db4a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:43.256374 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-69ef4845-8758-44ea-95f4-cd4ed246db4a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:43.272292 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-69ef4845-8758-44ea-95f4-cd4ed246db4a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:43.272732 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-69ef4845-8758-44ea-95f4-cd4ed246db4a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:43.273547 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-69ef4845-8758-44ea-95f4-cd4ed246db4a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:43.273981 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-69ef4845-8758-44ea-95f4-cd4ed246db4a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:43.357418 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a7b18185-93d1-455c-8688-c7539d2e0e53 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:43.377680 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a7b18185-93d1-455c-8688-c7539d2e0e53 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1507 microversion: 2.1 time: 0.374825 Jan 19 16:04:43.381522 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 216/417] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:42 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1507 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:43.390052 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-be05e543-8cb4-4efe-8b10-1400400a9d50 req-92e8d502-2dc3-4a1b-9e34-cde94ab870ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51253e38-0958-4960-8f9e-0bfa89782bd9", "tag": "7a71b7cf-9163-4282-a5e4-03603c991693"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:43.393337 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:04:43.393337 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:04:43.413287 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-be05e543-8cb4-4efe-8b10-1400400a9d50 req-92e8d502-2dc3-4a1b-9e34-cde94ab870ad service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:43.413595 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-be05e543-8cb4-4efe-8b10-1400400a9d50 req-92e8d502-2dc3-4a1b-9e34-cde94ab870ad service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:43.434532 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-be05e543-8cb4-4efe-8b10-1400400a9d50 req-92e8d502-2dc3-4a1b-9e34-cde94ab870ad service nova] Creating event network-changed:7a71b7cf-9163-4282-a5e4-03603c991693 for instance 51253e38-0958-4960-8f9e-0bfa89782bd9 on hv-cinder-82002 Jan 19 16:04:43.441424 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-be05e543-8cb4-4efe-8b10-1400400a9d50 req-92e8d502-2dc3-4a1b-9e34-cde94ab870ad service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058656 Jan 19 16:04:43.442402 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 217/418] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:04:43.618914 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-588c6d72-ce86-48ee-8051-227aabaaaae9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:43.619963 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-588c6d72-ce86-48ee-8051-227aabaaaae9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:43.627657 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-588c6d72-ce86-48ee-8051-227aabaaaae9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:43.628100 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-588c6d72-ce86-48ee-8051-227aabaaaae9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:43.628989 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-588c6d72-ce86-48ee-8051-227aabaaaae9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:43.629405 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-588c6d72-ce86-48ee-8051-227aabaaaae9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:43.752985 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-69ef4845-8758-44ea-95f4-cd4ed246db4a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:43.784069 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-69ef4845-8758-44ea-95f4-cd4ed246db4a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1317 microversion: 2.1 time: 0.520756 Jan 19 16:04:43.785766 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 202/419] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:43 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1317 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:43.794563 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-883f9d5e-08dc-449e-8dec-6a0555eb7190 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:43.796419 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-883f9d5e-08dc-449e-8dec-6a0555eb7190 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:43.808258 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-883f9d5e-08dc-449e-8dec-6a0555eb7190 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:43.809044 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-883f9d5e-08dc-449e-8dec-6a0555eb7190 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:43.810493 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-883f9d5e-08dc-449e-8dec-6a0555eb7190 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:43.811409 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-883f9d5e-08dc-449e-8dec-6a0555eb7190 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:44.105424 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-588c6d72-ce86-48ee-8051-227aabaaaae9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.490465 Jan 19 16:04:44.112088 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 218/420] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:43 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:44.120753 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8a23abb9-0fec-4579-8ba6-7969964de9d8 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:44.122051 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-8a23abb9-0fec-4579-8ba6-7969964de9d8 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:44.135209 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8a23abb9-0fec-4579-8ba6-7969964de9d8 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:44.135802 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8a23abb9-0fec-4579-8ba6-7969964de9d8 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:44.137244 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8a23abb9-0fec-4579-8ba6-7969964de9d8 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:44.138201 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8a23abb9-0fec-4579-8ba6-7969964de9d8 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:44.313101 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8a23abb9-0fec-4579-8ba6-7969964de9d8 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:44.323475 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-8a23abb9-0fec-4579-8ba6-7969964de9d8 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9" status: 200 len: 1319 microversion: 2.1 time: 0.209150 Jan 19 16:04:44.324586 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 219/421] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:44 2022] GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:44.330362 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-624902ab-96e0-402e-8e53-22be33317371 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:44.331059 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-624902ab-96e0-402e-8e53-22be33317371 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:44.338335 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-624902ab-96e0-402e-8e53-22be33317371 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:44.339087 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-624902ab-96e0-402e-8e53-22be33317371 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:44.339923 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-624902ab-96e0-402e-8e53-22be33317371 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:44.345370 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-624902ab-96e0-402e-8e53-22be33317371 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:44.490095 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-883f9d5e-08dc-449e-8dec-6a0555eb7190 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.702521 Jan 19 16:04:44.490963 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 203/422] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:43 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:44.497057 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-5c156f5c-9aeb-4b1d-b1d8-27fdeda14589 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:44.498310 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-5c156f5c-9aeb-4b1d-b1d8-27fdeda14589 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:44.509054 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5c156f5c-9aeb-4b1d-b1d8-27fdeda14589 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:44.509054 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5c156f5c-9aeb-4b1d-b1d8-27fdeda14589 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:44.509054 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5c156f5c-9aeb-4b1d-b1d8-27fdeda14589 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:44.509991 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5c156f5c-9aeb-4b1d-b1d8-27fdeda14589 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:44.536412 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-624902ab-96e0-402e-8e53-22be33317371 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:44.565101 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-624902ab-96e0-402e-8e53-22be33317371 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc" status: 200 len: 1314 microversion: 2.1 time: 0.239020 Jan 19 16:04:44.566205 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 220/423] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:44 2022] GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:44.802492 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-13475c11-062f-4c00-a44b-dd8eedeecf04 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:44.803164 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-13475c11-062f-4c00-a44b-dd8eedeecf04 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:44.810379 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-13475c11-062f-4c00-a44b-dd8eedeecf04 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:44.811436 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-13475c11-062f-4c00-a44b-dd8eedeecf04 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:44.812437 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-13475c11-062f-4c00-a44b-dd8eedeecf04 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:44.812870 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-13475c11-062f-4c00-a44b-dd8eedeecf04 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:44.867546 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-5c156f5c-9aeb-4b1d-b1d8-27fdeda14589 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:44.875457 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-5c156f5c-9aeb-4b1d-b1d8-27fdeda14589 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1507 microversion: 2.1 time: 0.382477 Jan 19 16:04:44.880401 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 204/424] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:44 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1507 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:45.061335 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-13475c11-062f-4c00-a44b-dd8eedeecf04 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:45.069731 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-13475c11-062f-4c00-a44b-dd8eedeecf04 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1317 microversion: 2.1 time: 0.271733 Jan 19 16:04:45.070452 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 221/425] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:44 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:45.118348 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-bd6e5d64-95b3-474b-957e-83d48122ee22 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:45.122311 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-bd6e5d64-95b3-474b-957e-83d48122ee22 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:45.127648 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bd6e5d64-95b3-474b-957e-83d48122ee22 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:45.128064 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bd6e5d64-95b3-474b-957e-83d48122ee22 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:45.128844 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bd6e5d64-95b3-474b-957e-83d48122ee22 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:45.129267 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bd6e5d64-95b3-474b-957e-83d48122ee22 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:45.233550 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-bd6e5d64-95b3-474b-957e-83d48122ee22 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.118749 Jan 19 16:04:45.234354 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 205/426] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:45 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:45.344386 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a3032a4d-c3f4-45c1-b595-11fcd4c2b557 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:45.345244 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a3032a4d-c3f4-45c1-b595-11fcd4c2b557 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:45.351928 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a3032a4d-c3f4-45c1-b595-11fcd4c2b557 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:45.352364 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a3032a4d-c3f4-45c1-b595-11fcd4c2b557 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:45.353144 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a3032a4d-c3f4-45c1-b595-11fcd4c2b557 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:45.353572 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a3032a4d-c3f4-45c1-b595-11fcd4c2b557 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:45.496054 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a3032a4d-c3f4-45c1-b595-11fcd4c2b557 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:45.502328 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-69c8f348-db27-45a4-b626-55d805ee2c70 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:45.503370 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-69c8f348-db27-45a4-b626-55d805ee2c70 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:45.505069 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a3032a4d-c3f4-45c1-b595-11fcd4c2b557 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9" status: 200 len: 1319 microversion: 2.1 time: 0.165058 Jan 19 16:04:45.505953 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 222/427] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:45 2022] GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:45.510565 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-69c8f348-db27-45a4-b626-55d805ee2c70 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:45.511037 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-69c8f348-db27-45a4-b626-55d805ee2c70 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:45.511839 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-69c8f348-db27-45a4-b626-55d805ee2c70 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:45.512274 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-69c8f348-db27-45a4-b626-55d805ee2c70 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:45.581418 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-69c8f348-db27-45a4-b626-55d805ee2c70 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.083174 Jan 19 16:04:45.582155 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 206/428] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:45 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:04:45.582592 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-48d5f4f0-fa09-49bb-a6ac-a4a163a80c32 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:45.583294 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-48d5f4f0-fa09-49bb-a6ac-a4a163a80c32 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:45.589245 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-48d5f4f0-fa09-49bb-a6ac-a4a163a80c32 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:45.589686 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-48d5f4f0-fa09-49bb-a6ac-a4a163a80c32 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:45.590469 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-48d5f4f0-fa09-49bb-a6ac-a4a163a80c32 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:45.590899 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-48d5f4f0-fa09-49bb-a6ac-a4a163a80c32 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:45.744262 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-48d5f4f0-fa09-49bb-a6ac-a4a163a80c32 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:45.752228 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-48d5f4f0-fa09-49bb-a6ac-a4a163a80c32 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc" status: 200 len: 1314 microversion: 2.1 time: 0.172793 Jan 19 16:04:45.752866 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 223/429] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:45 2022] GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:45.899377 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d03adb9d-4aa6-4e23-9209-43a96cc99bbc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:45.899989 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d03adb9d-4aa6-4e23-9209-43a96cc99bbc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:45.907258 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d03adb9d-4aa6-4e23-9209-43a96cc99bbc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:45.908196 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d03adb9d-4aa6-4e23-9209-43a96cc99bbc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:45.908997 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d03adb9d-4aa6-4e23-9209-43a96cc99bbc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:45.909430 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d03adb9d-4aa6-4e23-9209-43a96cc99bbc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:46.050326 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d03adb9d-4aa6-4e23-9209-43a96cc99bbc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:46.058598 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d03adb9d-4aa6-4e23-9209-43a96cc99bbc tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1507 microversion: 2.1 time: 0.163530 Jan 19 16:04:46.059231 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 207/430] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:45 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:46.087405 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b2b7c8ea-25bc-4863-bc55-a2595006c962 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:46.088138 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b2b7c8ea-25bc-4863-bc55-a2595006c962 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:46.095529 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b2b7c8ea-25bc-4863-bc55-a2595006c962 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:46.096006 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b2b7c8ea-25bc-4863-bc55-a2595006c962 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:46.096754 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b2b7c8ea-25bc-4863-bc55-a2595006c962 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:46.097297 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b2b7c8ea-25bc-4863-bc55-a2595006c962 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:46.233142 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-b2b7c8ea-25bc-4863-bc55-a2595006c962 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:46.245112 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b2b7c8ea-25bc-4863-bc55-a2595006c962 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1317 microversion: 2.1 time: 0.161645 Jan 19 16:04:46.245720 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 224/431] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:46 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:46.246709 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-a4ae981d-66fe-48d0-9ac9-040db5424b83 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:46.247702 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-a4ae981d-66fe-48d0-9ac9-040db5424b83 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:46.255359 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a4ae981d-66fe-48d0-9ac9-040db5424b83 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:46.255830 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a4ae981d-66fe-48d0-9ac9-040db5424b83 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:46.256636 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a4ae981d-66fe-48d0-9ac9-040db5424b83 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:46.257071 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a4ae981d-66fe-48d0-9ac9-040db5424b83 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:46.356078 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-a4ae981d-66fe-48d0-9ac9-040db5424b83 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.112684 Jan 19 16:04:46.357004 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 208/432] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:46 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:04:46.522472 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-156528a3-df83-4a31-9c44-cb348964e26e tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:46.523248 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-156528a3-df83-4a31-9c44-cb348964e26e tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:46.530093 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-156528a3-df83-4a31-9c44-cb348964e26e tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:46.530546 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-156528a3-df83-4a31-9c44-cb348964e26e tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:46.531391 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-156528a3-df83-4a31-9c44-cb348964e26e tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:46.531823 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-156528a3-df83-4a31-9c44-cb348964e26e tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:46.593101 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-80ac8eb9-2c25-4365-94ad-94150935c7ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:46.594332 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-80ac8eb9-2c25-4365-94ad-94150935c7ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:46.602351 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-80ac8eb9-2c25-4365-94ad-94150935c7ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:46.611225 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-80ac8eb9-2c25-4365-94ad-94150935c7ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:46.612226 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-80ac8eb9-2c25-4365-94ad-94150935c7ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:46.612674 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-80ac8eb9-2c25-4365-94ad-94150935c7ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:46.682762 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-156528a3-df83-4a31-9c44-cb348964e26e tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:46.691212 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-156528a3-df83-4a31-9c44-cb348964e26e tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9" status: 200 len: 1319 microversion: 2.1 time: 0.172399 Jan 19 16:04:46.692121 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 225/433] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:46 2022] GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:46.693870 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-80ac8eb9-2c25-4365-94ad-94150935c7ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.104904 Jan 19 16:04:46.694895 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 209/434] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:46 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:46.700928 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-739358f2-9af4-4c24-9bba-7c933b06145a req-09ce20dc-1d33-42a1-8bf8-b438c6c4a987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad149c5f-bf90-41d8-b480-18b9dafbd058", "name": "network-vif-plugged", "status": "completed", "tag": "cb6c185c-94b9-4994-9bb2-8b68be5d0408"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:46.702895 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:04:46.702895 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:04:46.710051 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-739358f2-9af4-4c24-9bba-7c933b06145a req-09ce20dc-1d33-42a1-8bf8-b438c6c4a987 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:46.710489 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-739358f2-9af4-4c24-9bba-7c933b06145a req-09ce20dc-1d33-42a1-8bf8-b438c6c4a987 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:46.722553 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-739358f2-9af4-4c24-9bba-7c933b06145a req-09ce20dc-1d33-42a1-8bf8-b438c6c4a987 service nova] Creating event network-vif-plugged:cb6c185c-94b9-4994-9bb2-8b68be5d0408 for instance ad149c5f-bf90-41d8-b480-18b9dafbd058 on hv-cinder-82002 Jan 19 16:04:46.727559 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-739358f2-9af4-4c24-9bba-7c933b06145a req-09ce20dc-1d33-42a1-8bf8-b438c6c4a987 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031195 Jan 19 16:04:46.728196 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 226/435] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:04:46.773119 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-307c30c5-0e6f-46d0-ab49-6dd828e43f38 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:46.773803 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-307c30c5-0e6f-46d0-ab49-6dd828e43f38 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:46.781793 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-307c30c5-0e6f-46d0-ab49-6dd828e43f38 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:46.783042 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-307c30c5-0e6f-46d0-ab49-6dd828e43f38 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:46.784011 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-307c30c5-0e6f-46d0-ab49-6dd828e43f38 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:46.784472 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-307c30c5-0e6f-46d0-ab49-6dd828e43f38 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:46.958273 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-307c30c5-0e6f-46d0-ab49-6dd828e43f38 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:46.966283 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-307c30c5-0e6f-46d0-ab49-6dd828e43f38 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc" status: 200 len: 1314 microversion: 2.1 time: 0.200803 Jan 19 16:04:46.966868 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 210/436] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:46 2022] GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:47.076224 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-97037132-81c9-40fb-a8c7-409e0e3b6b39 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:47.076925 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-97037132-81c9-40fb-a8c7-409e0e3b6b39 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:47.084089 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-97037132-81c9-40fb-a8c7-409e0e3b6b39 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:47.084541 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-97037132-81c9-40fb-a8c7-409e0e3b6b39 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:47.086017 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-97037132-81c9-40fb-a8c7-409e0e3b6b39 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:47.086726 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-97037132-81c9-40fb-a8c7-409e0e3b6b39 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:47.240632 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-97037132-81c9-40fb-a8c7-409e0e3b6b39 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:47.248473 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-97037132-81c9-40fb-a8c7-409e0e3b6b39 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1507 microversion: 2.1 time: 0.176328 Jan 19 16:04:47.249073 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 227/437] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:47 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:47.262713 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ced95211-0dc7-4b94-8129-389e7d6bd1ad tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:47.263349 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-ced95211-0dc7-4b94-8129-389e7d6bd1ad tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:47.270441 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ced95211-0dc7-4b94-8129-389e7d6bd1ad tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:47.270885 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ced95211-0dc7-4b94-8129-389e7d6bd1ad tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:47.271706 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ced95211-0dc7-4b94-8129-389e7d6bd1ad tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:47.272129 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ced95211-0dc7-4b94-8129-389e7d6bd1ad tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:47.368032 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c87bc895-2ddc-4dcb-bade-e1bccd917314 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:47.368997 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c87bc895-2ddc-4dcb-bade-e1bccd917314 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:47.374828 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c87bc895-2ddc-4dcb-bade-e1bccd917314 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:47.375329 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c87bc895-2ddc-4dcb-bade-e1bccd917314 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:47.376704 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c87bc895-2ddc-4dcb-bade-e1bccd917314 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:47.377143 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c87bc895-2ddc-4dcb-bade-e1bccd917314 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:47.409693 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ced95211-0dc7-4b94-8129-389e7d6bd1ad tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:47.417869 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-ced95211-0dc7-4b94-8129-389e7d6bd1ad tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1317 microversion: 2.1 time: 0.158877 Jan 19 16:04:47.418474 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 211/438] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:47 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:47.544923 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c87bc895-2ddc-4dcb-bade-e1bccd917314 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.180305 Jan 19 16:04:47.545603 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 228/439] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:47 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:04:47.706303 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-b25cb0c8-cebc-41ec-8340-5944396d2bfb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:47.707289 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-b25cb0c8-cebc-41ec-8340-5944396d2bfb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:47.708397 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d7dbc40f-e325-43ce-bb83-c7680e0dbff2 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:47.709108 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-d7dbc40f-e325-43ce-bb83-c7680e0dbff2 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:47.714273 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b25cb0c8-cebc-41ec-8340-5944396d2bfb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:47.714769 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b25cb0c8-cebc-41ec-8340-5944396d2bfb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:47.715601 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b25cb0c8-cebc-41ec-8340-5944396d2bfb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:47.716033 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b25cb0c8-cebc-41ec-8340-5944396d2bfb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:47.716134 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d7dbc40f-e325-43ce-bb83-c7680e0dbff2 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:47.716484 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d7dbc40f-e325-43ce-bb83-c7680e0dbff2 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:47.717279 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d7dbc40f-e325-43ce-bb83-c7680e0dbff2 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:47.717712 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d7dbc40f-e325-43ce-bb83-c7680e0dbff2 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:47.854679 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-d7dbc40f-e325-43ce-bb83-c7680e0dbff2 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:47.863200 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-d7dbc40f-e325-43ce-bb83-c7680e0dbff2 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9" status: 200 len: 1319 microversion: 2.1 time: 0.158790 Jan 19 16:04:47.863712 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 229/440] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:47 2022] GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:47.955839 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-b25cb0c8-cebc-41ec-8340-5944396d2bfb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.253365 Jan 19 16:04:47.956511 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 212/441] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:47 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:47.989441 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f5b78aad-6463-4184-b0b5-1895b9b1d478 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:47.990045 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f5b78aad-6463-4184-b0b5-1895b9b1d478 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:47.996487 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f5b78aad-6463-4184-b0b5-1895b9b1d478 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:47.996931 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f5b78aad-6463-4184-b0b5-1895b9b1d478 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:47.997716 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f5b78aad-6463-4184-b0b5-1895b9b1d478 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:47.998150 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f5b78aad-6463-4184-b0b5-1895b9b1d478 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:48.147652 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f5b78aad-6463-4184-b0b5-1895b9b1d478 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:48.156491 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f5b78aad-6463-4184-b0b5-1895b9b1d478 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc" status: 200 len: 1314 microversion: 2.1 time: 0.171015 Jan 19 16:04:48.157821 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 230/442] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:47 2022] GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:48.267293 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-b8a8f1ae-7220-442e-9a3e-c9777f1dfbed tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:48.267978 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-b8a8f1ae-7220-442e-9a3e-c9777f1dfbed tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:48.275244 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b8a8f1ae-7220-442e-9a3e-c9777f1dfbed tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:48.275684 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b8a8f1ae-7220-442e-9a3e-c9777f1dfbed tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:48.276464 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b8a8f1ae-7220-442e-9a3e-c9777f1dfbed tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:48.276889 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b8a8f1ae-7220-442e-9a3e-c9777f1dfbed tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:48.423130 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-b8a8f1ae-7220-442e-9a3e-c9777f1dfbed tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:48.435924 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-b8a8f1ae-7220-442e-9a3e-c9777f1dfbed tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1507 microversion: 2.1 time: 0.173191 Jan 19 16:04:48.436436 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c8d33e44-db77-4127-9f9a-3b3cb252612e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:48.437360 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 213/443] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:48 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:48.437459 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c8d33e44-db77-4127-9f9a-3b3cb252612e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:48.444827 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c8d33e44-db77-4127-9f9a-3b3cb252612e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:48.445707 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c8d33e44-db77-4127-9f9a-3b3cb252612e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:48.446516 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c8d33e44-db77-4127-9f9a-3b3cb252612e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:48.446954 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c8d33e44-db77-4127-9f9a-3b3cb252612e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:48.557359 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d1206164-46a7-4528-a6b3-715ad45e8e3c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:48.558272 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d1206164-46a7-4528-a6b3-715ad45e8e3c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:48.565391 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d1206164-46a7-4528-a6b3-715ad45e8e3c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:48.565835 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d1206164-46a7-4528-a6b3-715ad45e8e3c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:48.566630 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d1206164-46a7-4528-a6b3-715ad45e8e3c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:48.567570 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d1206164-46a7-4528-a6b3-715ad45e8e3c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:48.632904 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c8d33e44-db77-4127-9f9a-3b3cb252612e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:48.643592 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c8d33e44-db77-4127-9f9a-3b3cb252612e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1317 microversion: 2.1 time: 0.208359 Jan 19 16:04:48.646336 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d1206164-46a7-4528-a6b3-715ad45e8e3c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.092070 Jan 19 16:04:48.647041 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 214/444] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:48 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:48.655276 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 231/445] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:48 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:48.882643 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-36ab12b0-984d-4cd4-b834-14def420270a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:48.887338 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-36ab12b0-984d-4cd4-b834-14def420270a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:48.890888 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-36ab12b0-984d-4cd4-b834-14def420270a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:48.891388 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-36ab12b0-984d-4cd4-b834-14def420270a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:48.892244 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-36ab12b0-984d-4cd4-b834-14def420270a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:48.892685 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-36ab12b0-984d-4cd4-b834-14def420270a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:48.968374 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d129e4ee-442d-44be-bc75-e651bcacc66e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:48.969351 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-d129e4ee-442d-44be-bc75-e651bcacc66e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:48.980801 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d129e4ee-442d-44be-bc75-e651bcacc66e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:48.981273 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d129e4ee-442d-44be-bc75-e651bcacc66e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:48.982107 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d129e4ee-442d-44be-bc75-e651bcacc66e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:48.982949 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d129e4ee-442d-44be-bc75-e651bcacc66e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:49.074147 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-36ab12b0-984d-4cd4-b834-14def420270a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:49.084571 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-36ab12b0-984d-4cd4-b834-14def420270a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9" status: 200 len: 1319 microversion: 2.1 time: 0.206711 Jan 19 16:04:49.085942 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 215/446] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:48 2022] GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:49.125042 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-d129e4ee-442d-44be-bc75-e651bcacc66e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.160255 Jan 19 16:04:49.125731 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 232/447] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:48 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:49.175465 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-7aec9d5c-56e4-4bc4-ae82-d0d19cafc267 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:49.176067 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-7aec9d5c-56e4-4bc4-ae82-d0d19cafc267 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:49.185953 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7aec9d5c-56e4-4bc4-ae82-d0d19cafc267 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:49.186750 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7aec9d5c-56e4-4bc4-ae82-d0d19cafc267 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:49.190203 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7aec9d5c-56e4-4bc4-ae82-d0d19cafc267 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:49.190203 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7aec9d5c-56e4-4bc4-ae82-d0d19cafc267 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:49.371286 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-7aec9d5c-56e4-4bc4-ae82-d0d19cafc267 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:49.381650 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-7aec9d5c-56e4-4bc4-ae82-d0d19cafc267 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc" status: 200 len: 1314 microversion: 2.1 time: 0.210147 Jan 19 16:04:49.382517 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 216/448] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:49 2022] GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:49.453860 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d88a9231-d22c-4453-bb85-d610a18426c9 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:49.454596 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-d88a9231-d22c-4453-bb85-d610a18426c9 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:49.462131 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d88a9231-d22c-4453-bb85-d610a18426c9 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:49.462572 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d88a9231-d22c-4453-bb85-d610a18426c9 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:49.463460 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d88a9231-d22c-4453-bb85-d610a18426c9 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:49.463889 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d88a9231-d22c-4453-bb85-d610a18426c9 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:49.609795 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-d88a9231-d22c-4453-bb85-d610a18426c9 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:49.618850 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-d88a9231-d22c-4453-bb85-d610a18426c9 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1513 microversion: 2.1 time: 0.169102 Jan 19 16:04:49.619767 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 233/449] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:49 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:49.661644 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-03a774dc-3e0a-4387-8e91-93210ca20b78 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:49.662642 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-03a774dc-3e0a-4387-8e91-93210ca20b78 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:49.663685 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-dd3deec8-c914-4b37-bebe-89e74b0be4c9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:49.664472 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-dd3deec8-c914-4b37-bebe-89e74b0be4c9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:49.669359 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-03a774dc-3e0a-4387-8e91-93210ca20b78 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:49.669700 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-03a774dc-3e0a-4387-8e91-93210ca20b78 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:49.670669 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-03a774dc-3e0a-4387-8e91-93210ca20b78 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:49.670825 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dd3deec8-c914-4b37-bebe-89e74b0be4c9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:49.671252 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dd3deec8-c914-4b37-bebe-89e74b0be4c9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:49.671373 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-03a774dc-3e0a-4387-8e91-93210ca20b78 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:49.672037 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dd3deec8-c914-4b37-bebe-89e74b0be4c9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:49.672473 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dd3deec8-c914-4b37-bebe-89e74b0be4c9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:49.762240 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-03a774dc-3e0a-4387-8e91-93210ca20b78 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.104713 Jan 19 16:04:49.763564 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 217/450] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:49 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:49.830227 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-dd3deec8-c914-4b37-bebe-89e74b0be4c9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:49.839445 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-dd3deec8-c914-4b37-bebe-89e74b0be4c9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1317 microversion: 2.1 time: 0.181454 Jan 19 16:04:49.841893 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 234/451] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:49 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:50.102538 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-fd66ff06-fd6b-4928-95e0-1d6358b6f7d1 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:50.103775 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-fd66ff06-fd6b-4928-95e0-1d6358b6f7d1 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:50.111789 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fd66ff06-fd6b-4928-95e0-1d6358b6f7d1 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:50.112646 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fd66ff06-fd6b-4928-95e0-1d6358b6f7d1 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:50.113553 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fd66ff06-fd6b-4928-95e0-1d6358b6f7d1 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:50.114207 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fd66ff06-fd6b-4928-95e0-1d6358b6f7d1 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:50.149679 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-1ea754d9-8e3e-43a1-b5a4-6f1a5e159d7f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:50.152989 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-1ea754d9-8e3e-43a1-b5a4-6f1a5e159d7f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:50.233061 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1ea754d9-8e3e-43a1-b5a4-6f1a5e159d7f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:50.236294 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1ea754d9-8e3e-43a1-b5a4-6f1a5e159d7f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:50.240729 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1ea754d9-8e3e-43a1-b5a4-6f1a5e159d7f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:50.248959 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1ea754d9-8e3e-43a1-b5a4-6f1a5e159d7f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:50.351412 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-1ea754d9-8e3e-43a1-b5a4-6f1a5e159d7f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.215696 Jan 19 16:04:50.352768 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 235/452] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:50 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:04:50.407371 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b150a015-7ad3-4086-9f27-6b5f1b34e641 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:50.408370 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b150a015-7ad3-4086-9f27-6b5f1b34e641 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:50.413553 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-fd66ff06-fd6b-4928-95e0-1d6358b6f7d1 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:50.425099 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b150a015-7ad3-4086-9f27-6b5f1b34e641 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:50.425614 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-fd66ff06-fd6b-4928-95e0-1d6358b6f7d1 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9" status: 200 len: 1319 microversion: 2.1 time: 0.327219 Jan 19 16:04:50.425736 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b150a015-7ad3-4086-9f27-6b5f1b34e641 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:50.426001 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 218/453] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:50 2022] GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9 => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:50.426658 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b150a015-7ad3-4086-9f27-6b5f1b34e641 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:50.427525 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b150a015-7ad3-4086-9f27-6b5f1b34e641 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:50.578922 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-b150a015-7ad3-4086-9f27-6b5f1b34e641 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:50.586921 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b150a015-7ad3-4086-9f27-6b5f1b34e641 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc" status: 200 len: 1314 microversion: 2.1 time: 0.185927 Jan 19 16:04:50.587537 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 236/454] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:50 2022] GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:50.776714 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-9c276c5c-b847-47cb-a02c-96c1cbff22da tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:50.777780 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-9c276c5c-b847-47cb-a02c-96c1cbff22da tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:50.791470 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9c276c5c-b847-47cb-a02c-96c1cbff22da tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:50.792264 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9c276c5c-b847-47cb-a02c-96c1cbff22da tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:50.795531 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9c276c5c-b847-47cb-a02c-96c1cbff22da tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:50.795531 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9c276c5c-b847-47cb-a02c-96c1cbff22da tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:50.856982 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-84769fa8-3a13-4628-b5a0-a7f95fd0e40e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:50.857491 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-84769fa8-3a13-4628-b5a0-a7f95fd0e40e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:50.864683 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-84769fa8-3a13-4628-b5a0-a7f95fd0e40e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:50.865870 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-84769fa8-3a13-4628-b5a0-a7f95fd0e40e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:50.866008 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-84769fa8-3a13-4628-b5a0-a7f95fd0e40e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:50.866322 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-84769fa8-3a13-4628-b5a0-a7f95fd0e40e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:50.887035 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-9c276c5c-b847-47cb-a02c-96c1cbff22da tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.115873 Jan 19 16:04:50.888111 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 219/455] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:50 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:51.026226 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-84769fa8-3a13-4628-b5a0-a7f95fd0e40e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:51.034860 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-84769fa8-3a13-4628-b5a0-a7f95fd0e40e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1508 microversion: 2.1 time: 0.181574 Jan 19 16:04:51.035604 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 237/456] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:50 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:51.366528 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-5d2b1bbc-bf59-4a72-8318-9880e1ac38c9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:51.367569 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-5d2b1bbc-bf59-4a72-8318-9880e1ac38c9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:51.375956 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5d2b1bbc-bf59-4a72-8318-9880e1ac38c9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:51.376395 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5d2b1bbc-bf59-4a72-8318-9880e1ac38c9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:51.377665 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5d2b1bbc-bf59-4a72-8318-9880e1ac38c9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:51.378098 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5d2b1bbc-bf59-4a72-8318-9880e1ac38c9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:51.450579 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c9114cc3-cf06-4eb5-a4e8-d451d43366c1 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:51.451222 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c9114cc3-cf06-4eb5-a4e8-d451d43366c1 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:51.458480 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c9114cc3-cf06-4eb5-a4e8-d451d43366c1 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:51.458921 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c9114cc3-cf06-4eb5-a4e8-d451d43366c1 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:51.459745 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c9114cc3-cf06-4eb5-a4e8-d451d43366c1 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:51.460184 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c9114cc3-cf06-4eb5-a4e8-d451d43366c1 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:51.595879 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-5d2b1bbc-bf59-4a72-8318-9880e1ac38c9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.233860 Jan 19 16:04:51.599777 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 220/457] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:51 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:51.605977 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-3932c4e2-6239-4df9-9b3e-65f5fdbe0e55 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:51.606801 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-3932c4e2-6239-4df9-9b3e-65f5fdbe0e55 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:51.612918 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c9114cc3-cf06-4eb5-a4e8-d451d43366c1 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:51.614115 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3932c4e2-6239-4df9-9b3e-65f5fdbe0e55 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:51.615067 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3932c4e2-6239-4df9-9b3e-65f5fdbe0e55 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:51.615558 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3932c4e2-6239-4df9-9b3e-65f5fdbe0e55 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:51.616002 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3932c4e2-6239-4df9-9b3e-65f5fdbe0e55 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:51.631517 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c9114cc3-cf06-4eb5-a4e8-d451d43366c1 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9" status: 200 len: 1319 microversion: 2.1 time: 0.183782 Jan 19 16:04:51.633633 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 238/458] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:51 2022] GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:51.782648 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-3932c4e2-6239-4df9-9b3e-65f5fdbe0e55 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:51.790765 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-3932c4e2-6239-4df9-9b3e-65f5fdbe0e55 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc" status: 200 len: 1314 microversion: 2.1 time: 0.188722 Jan 19 16:04:51.800263 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 221/459] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:51 2022] GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:51.897688 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d1c8fee8-a757-47d7-9791-0b8f443c86a3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:51.898675 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-d1c8fee8-a757-47d7-9791-0b8f443c86a3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:51.905577 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d1c8fee8-a757-47d7-9791-0b8f443c86a3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:51.906021 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d1c8fee8-a757-47d7-9791-0b8f443c86a3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:51.907033 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d1c8fee8-a757-47d7-9791-0b8f443c86a3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:51.907473 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d1c8fee8-a757-47d7-9791-0b8f443c86a3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:51.971857 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-d1c8fee8-a757-47d7-9791-0b8f443c86a3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.077334 Jan 19 16:04:51.972441 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 239/460] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:51 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:52.417842 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-2510ae88-4515-48ea-8766-06a4bd4d3660 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:52.418450 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-2510ae88-4515-48ea-8766-06a4bd4d3660 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:52.426725 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2510ae88-4515-48ea-8766-06a4bd4d3660 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:52.427226 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2510ae88-4515-48ea-8766-06a4bd4d3660 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:52.428011 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2510ae88-4515-48ea-8766-06a4bd4d3660 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:52.428658 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2510ae88-4515-48ea-8766-06a4bd4d3660 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:52.600216 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-2510ae88-4515-48ea-8766-06a4bd4d3660 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:52.607907 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-2510ae88-4515-48ea-8766-06a4bd4d3660 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1513 microversion: 2.1 time: 0.193640 Jan 19 16:04:52.608740 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 222/461] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:52 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:52.619213 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d393a16b-a3e4-4b95-99dd-b2a41bd4f9df tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:52.619213 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-d393a16b-a3e4-4b95-99dd-b2a41bd4f9df tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:52.620559 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d393a16b-a3e4-4b95-99dd-b2a41bd4f9df tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:52.620559 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d393a16b-a3e4-4b95-99dd-b2a41bd4f9df tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:52.620956 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d393a16b-a3e4-4b95-99dd-b2a41bd4f9df tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:52.621393 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d393a16b-a3e4-4b95-99dd-b2a41bd4f9df tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:52.626555 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-68da74a7-55a5-4833-b241-91eaf3b9218d tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2a74569-e22e-4610-ab13-b92a383276fd"}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:52.628966 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-68da74a7-55a5-4833-b241-91eaf3b9218d tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:52.635264 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-68da74a7-55a5-4833-b241-91eaf3b9218d tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:52.635760 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-68da74a7-55a5-4833-b241-91eaf3b9218d tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:52.636564 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-68da74a7-55a5-4833-b241-91eaf3b9218d tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:52.637635 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-68da74a7-55a5-4833-b241-91eaf3b9218d tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:52.689715 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-d393a16b-a3e4-4b95-99dd-b2a41bd4f9df tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.082811 Jan 19 16:04:52.694048 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 240/462] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:52 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:52.695613 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-99d81040-7b05-426e-8df4-6e97218d7d72 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:52.696303 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-99d81040-7b05-426e-8df4-6e97218d7d72 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:52.703288 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-99d81040-7b05-426e-8df4-6e97218d7d72 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:52.703734 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-99d81040-7b05-426e-8df4-6e97218d7d72 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:52.705066 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-99d81040-7b05-426e-8df4-6e97218d7d72 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:52.705496 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-99d81040-7b05-426e-8df4-6e97218d7d72 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:52.863903 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-99d81040-7b05-426e-8df4-6e97218d7d72 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:52.871545 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-99d81040-7b05-426e-8df4-6e97218d7d72 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9" status: 200 len: 1319 microversion: 2.1 time: 0.179639 Jan 19 16:04:52.872135 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 241/463] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:52 2022] GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:52.894818 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-6d398633-d022-4e77-b3bf-4555bf1405e9 req-4f7145be-1bdd-4904-9b38-38bf0462a1eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8efdc25-ba11-4f86-8383-4bc10280edbc", "name": "network-vif-plugged", "status": "completed", "tag": "56d9765d-44b0-4cba-9c25-f5408ceb4492"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:52.894818 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:04:52.894818 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:04:52.894818 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-6d398633-d022-4e77-b3bf-4555bf1405e9 req-4f7145be-1bdd-4904-9b38-38bf0462a1eb service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:52.894818 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-6d398633-d022-4e77-b3bf-4555bf1405e9 req-4f7145be-1bdd-4904-9b38-38bf0462a1eb service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:52.898115 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-6d398633-d022-4e77-b3bf-4555bf1405e9 req-4f7145be-1bdd-4904-9b38-38bf0462a1eb service nova] Creating event network-vif-plugged:56d9765d-44b0-4cba-9c25-f5408ceb4492 for instance c8efdc25-ba11-4f86-8383-4bc10280edbc on hv-cinder-82002 Jan 19 16:04:52.903042 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-6d398633-d022-4e77-b3bf-4555bf1405e9 req-4f7145be-1bdd-4904-9b38-38bf0462a1eb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029660 Jan 19 16:04:52.903576 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 242/464] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:04:52.909113 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-fe035b7b-455e-449f-bcee-38c99a50ca81 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:52.909804 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-fe035b7b-455e-449f-bcee-38c99a50ca81 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:52.916865 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fe035b7b-455e-449f-bcee-38c99a50ca81 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:52.917358 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fe035b7b-455e-449f-bcee-38c99a50ca81 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:52.918257 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fe035b7b-455e-449f-bcee-38c99a50ca81 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:52.918746 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fe035b7b-455e-449f-bcee-38c99a50ca81 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:53.072744 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-fe035b7b-455e-449f-bcee-38c99a50ca81 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:53.080968 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-fe035b7b-455e-449f-bcee-38c99a50ca81 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc" status: 200 len: 1314 microversion: 2.1 time: 0.176260 Jan 19 16:04:53.081544 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 243/465] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:52 2022] GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:53.085952 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a6c7645d-ae4e-4068-b5e2-4ab94ce44deb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:53.086855 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a6c7645d-ae4e-4068-b5e2-4ab94ce44deb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:53.092592 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a6c7645d-ae4e-4068-b5e2-4ab94ce44deb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:53.093052 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a6c7645d-ae4e-4068-b5e2-4ab94ce44deb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:53.093814 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a6c7645d-ae4e-4068-b5e2-4ab94ce44deb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:53.094239 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a6c7645d-ae4e-4068-b5e2-4ab94ce44deb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:53.163437 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a6c7645d-ae4e-4068-b5e2-4ab94ce44deb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.080574 Jan 19 16:04:53.164074 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 244/466] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:53 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:53.567255 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-68da74a7-55a5-4833-b241-91eaf3b9218d tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "POST /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.945420 Jan 19 16:04:53.567898 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 223/467] 10.222.0.58 () {60 vars in 1322 bytes} [Wed Jan 19 16:04:52 2022] POST /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments => generated 194 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:04:53.709714 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-26fcc5df-82c6-47b3-8e08-4224416f8aa8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:53.711477 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-26fcc5df-82c6-47b3-8e08-4224416f8aa8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:53.723227 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-26fcc5df-82c6-47b3-8e08-4224416f8aa8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:53.724050 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-26fcc5df-82c6-47b3-8e08-4224416f8aa8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:53.725445 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-26fcc5df-82c6-47b3-8e08-4224416f8aa8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:53.726156 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-26fcc5df-82c6-47b3-8e08-4224416f8aa8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:53.793874 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-26fcc5df-82c6-47b3-8e08-4224416f8aa8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.095406 Jan 19 16:04:53.794393 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 245/468] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:53 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:53.833055 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-14a1b9ad-0ff7-49b6-9f0e-2d51f31bf8b5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd6d9866-4086-4986-827a-8b11210b6546"}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:53.834200 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-14a1b9ad-0ff7-49b6-9f0e-2d51f31bf8b5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:53.840982 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-14a1b9ad-0ff7-49b6-9f0e-2d51f31bf8b5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:53.841424 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-14a1b9ad-0ff7-49b6-9f0e-2d51f31bf8b5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:53.842276 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-14a1b9ad-0ff7-49b6-9f0e-2d51f31bf8b5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:53.842648 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-14a1b9ad-0ff7-49b6-9f0e-2d51f31bf8b5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:53.888778 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-94e28f95-3b00-4d5d-9f10-114fe368d80a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:53.889693 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-94e28f95-3b00-4d5d-9f10-114fe368d80a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:53.899249 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-94e28f95-3b00-4d5d-9f10-114fe368d80a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:53.899735 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-94e28f95-3b00-4d5d-9f10-114fe368d80a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:53.900612 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-94e28f95-3b00-4d5d-9f10-114fe368d80a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:53.901256 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-94e28f95-3b00-4d5d-9f10-114fe368d80a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:54.052927 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-94e28f95-3b00-4d5d-9f10-114fe368d80a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:54.060993 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-94e28f95-3b00-4d5d-9f10-114fe368d80a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9" status: 200 len: 1319 microversion: 2.1 time: 0.176214 Jan 19 16:04:54.061591 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 246/469] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:53 2022] GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:54.097437 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5074cfcc-d748-4dab-8f05-6177a34bbd6a tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:54.098173 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5074cfcc-d748-4dab-8f05-6177a34bbd6a tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:54.104585 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5074cfcc-d748-4dab-8f05-6177a34bbd6a tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:54.110760 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5074cfcc-d748-4dab-8f05-6177a34bbd6a tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:54.110760 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5074cfcc-d748-4dab-8f05-6177a34bbd6a tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:54.110760 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5074cfcc-d748-4dab-8f05-6177a34bbd6a tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:54.264303 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5074cfcc-d748-4dab-8f05-6177a34bbd6a tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:54.278125 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5074cfcc-d748-4dab-8f05-6177a34bbd6a tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc" status: 200 len: 1314 microversion: 2.1 time: 0.184224 Jan 19 16:04:54.278883 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 247/470] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:54 2022] GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:54.286073 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-96caaf37-0a72-4152-90c8-3043af2fa850 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:54.287826 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-96caaf37-0a72-4152-90c8-3043af2fa850 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:54.299530 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-96caaf37-0a72-4152-90c8-3043af2fa850 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:54.300361 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-96caaf37-0a72-4152-90c8-3043af2fa850 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:54.302118 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-96caaf37-0a72-4152-90c8-3043af2fa850 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:54.302945 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-96caaf37-0a72-4152-90c8-3043af2fa850 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:54.462690 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-96caaf37-0a72-4152-90c8-3043af2fa850 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.182148 Jan 19 16:04:54.464049 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 248/471] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:54 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:54.721766 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-14a1b9ad-0ff7-49b6-9f0e-2d51f31bf8b5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "POST /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.893628 Jan 19 16:04:54.722408 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 224/472] 10.222.0.58 () {60 vars in 1322 bytes} [Wed Jan 19 16:04:53 2022] POST /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058/os-volume_attachments => generated 194 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:04:54.819426 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-bf37eb53-9ef4-4bb1-b89f-450d430410d4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:54.819426 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-bf37eb53-9ef4-4bb1-b89f-450d430410d4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:54.819426 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bf37eb53-9ef4-4bb1-b89f-450d430410d4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:54.819426 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bf37eb53-9ef4-4bb1-b89f-450d430410d4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:54.820125 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bf37eb53-9ef4-4bb1-b89f-450d430410d4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:54.820125 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bf37eb53-9ef4-4bb1-b89f-450d430410d4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:54.919560 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-84b0beb0-74bc-4e27-9589-86122a49c997 req-81ef14ba-587c-4d50-8707-fe04be0f682a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51253e38-0958-4960-8f9e-0bfa89782bd9", "name": "network-vif-plugged", "status": "completed", "tag": "7a71b7cf-9163-4282-a5e4-03603c991693"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:54.921277 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:04:54.921277 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:04:54.928840 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-bf37eb53-9ef4-4bb1-b89f-450d430410d4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.125524 Jan 19 16:04:54.934051 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 249/473] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:54 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:04:54.934237 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-84b0beb0-74bc-4e27-9589-86122a49c997 req-81ef14ba-587c-4d50-8707-fe04be0f682a service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:54.934237 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-84b0beb0-74bc-4e27-9589-86122a49c997 req-81ef14ba-587c-4d50-8707-fe04be0f682a service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:54.944499 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-84b0beb0-74bc-4e27-9589-86122a49c997 req-81ef14ba-587c-4d50-8707-fe04be0f682a service nova] Creating event network-vif-plugged:7a71b7cf-9163-4282-a5e4-03603c991693 for instance 51253e38-0958-4960-8f9e-0bfa89782bd9 on hv-cinder-82002 Jan 19 16:04:54.949545 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-84b0beb0-74bc-4e27-9589-86122a49c997 req-81ef14ba-587c-4d50-8707-fe04be0f682a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034142 Jan 19 16:04:54.951451 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 225/474] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:04:55.078515 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-595ab208-d962-4845-8c1c-68cca2aec44e tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:55.079466 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-595ab208-d962-4845-8c1c-68cca2aec44e tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:55.093713 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-595ab208-d962-4845-8c1c-68cca2aec44e tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:55.094157 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-595ab208-d962-4845-8c1c-68cca2aec44e tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:55.095020 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-595ab208-d962-4845-8c1c-68cca2aec44e tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:55.101064 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-595ab208-d962-4845-8c1c-68cca2aec44e tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:55.255597 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-595ab208-d962-4845-8c1c-68cca2aec44e tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:55.263024 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-595ab208-d962-4845-8c1c-68cca2aec44e tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9" status: 200 len: 1319 microversion: 2.1 time: 0.188742 Jan 19 16:04:55.264812 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 250/475] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:55 2022] GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:55.295593 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-adab01a5-7b6b-4269-8f69-a52e960b3b5b tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:55.296552 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-adab01a5-7b6b-4269-8f69-a52e960b3b5b tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:55.305295 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-adab01a5-7b6b-4269-8f69-a52e960b3b5b tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:55.307342 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-adab01a5-7b6b-4269-8f69-a52e960b3b5b tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:55.307342 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-adab01a5-7b6b-4269-8f69-a52e960b3b5b tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:55.307342 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-adab01a5-7b6b-4269-8f69-a52e960b3b5b tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:55.467835 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-adab01a5-7b6b-4269-8f69-a52e960b3b5b tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:55.475402 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-342f49ff-7366-4bda-aeeb-0e1ab816dfc3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:55.476309 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-342f49ff-7366-4bda-aeeb-0e1ab816dfc3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:55.476445 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-adab01a5-7b6b-4269-8f69-a52e960b3b5b tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc" status: 200 len: 1314 microversion: 2.1 time: 0.184603 Jan 19 16:04:55.476905 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 226/476] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:55 2022] GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:55.482712 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-342f49ff-7366-4bda-aeeb-0e1ab816dfc3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:55.483348 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-342f49ff-7366-4bda-aeeb-0e1ab816dfc3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:55.483978 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-342f49ff-7366-4bda-aeeb-0e1ab816dfc3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:55.484408 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-342f49ff-7366-4bda-aeeb-0e1ab816dfc3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:55.806403 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-342f49ff-7366-4bda-aeeb-0e1ab816dfc3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.334392 Jan 19 16:04:55.807631 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 251/477] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:55 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:04:55.942550 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-99695991-fbe0-415a-b63e-2ed72a7f9441 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:55.943411 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-99695991-fbe0-415a-b63e-2ed72a7f9441 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:55.949468 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-99695991-fbe0-415a-b63e-2ed72a7f9441 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:55.950331 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-99695991-fbe0-415a-b63e-2ed72a7f9441 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:55.950734 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-99695991-fbe0-415a-b63e-2ed72a7f9441 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:55.951279 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-99695991-fbe0-415a-b63e-2ed72a7f9441 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:56.049124 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-99695991-fbe0-415a-b63e-2ed72a7f9441 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.110284 Jan 19 16:04:56.053519 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 227/478] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:55 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:56.280086 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-9fcce64f-f81a-46dc-80d6-d22a384a23f6 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:56.280812 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-9fcce64f-f81a-46dc-80d6-d22a384a23f6 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:56.288723 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9fcce64f-f81a-46dc-80d6-d22a384a23f6 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:56.289205 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9fcce64f-f81a-46dc-80d6-d22a384a23f6 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:56.290061 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9fcce64f-f81a-46dc-80d6-d22a384a23f6 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:56.290512 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9fcce64f-f81a-46dc-80d6-d22a384a23f6 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:56.434631 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-9fcce64f-f81a-46dc-80d6-d22a384a23f6 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:56.443092 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-9fcce64f-f81a-46dc-80d6-d22a384a23f6 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9" status: 200 len: 1319 microversion: 2.1 time: 0.166621 Jan 19 16:04:56.443256 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 252/479] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:56 2022] GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:56.494348 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-627fa483-081c-4b4b-aea5-42e3606f860f tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:56.495154 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-627fa483-081c-4b4b-aea5-42e3606f860f tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:56.502255 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-627fa483-081c-4b4b-aea5-42e3606f860f tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:56.502656 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-627fa483-081c-4b4b-aea5-42e3606f860f tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:56.503469 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-627fa483-081c-4b4b-aea5-42e3606f860f tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:56.504446 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-627fa483-081c-4b4b-aea5-42e3606f860f tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:56.670827 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-627fa483-081c-4b4b-aea5-42e3606f860f tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:56.680002 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-627fa483-081c-4b4b-aea5-42e3606f860f tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc" status: 200 len: 1497 microversion: 2.1 time: 0.189886 Jan 19 16:04:56.680756 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 228/480] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:56 2022] GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:56.826310 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-81acebfe-2d8d-4f27-9f85-2a7ca9a89311 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:56.833746 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-81acebfe-2d8d-4f27-9f85-2a7ca9a89311 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:56.847253 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-81acebfe-2d8d-4f27-9f85-2a7ca9a89311 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:56.847253 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-81acebfe-2d8d-4f27-9f85-2a7ca9a89311 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:56.847253 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-81acebfe-2d8d-4f27-9f85-2a7ca9a89311 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:56.847483 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-81acebfe-2d8d-4f27-9f85-2a7ca9a89311 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:56.910642 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-2ead9a61-4896-478a-985e-f894965acd14 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-594852148", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1630068289", "security_groups": [{"name": "tempest-secgroup-smoke-364405160"}], "block_device_mapping_v2": [{"uuid": "0edf87cf-f4af-45e4-8536-eb0bd6710999", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "59d48545-e392-481c-8443-e9229e177c3f"}]}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:56.944607 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-81acebfe-2d8d-4f27-9f85-2a7ca9a89311 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.122921 Jan 19 16:04:56.944607 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 253/481] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:56 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:57.030703 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.network.neutron [None req-2ead9a61-4896-478a-985e-f894965acd14 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] validate_networks() for [('59d48545-e392-481c-8443-e9229e177c3f', None, None, None, None, None)] {{(pid=128875) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:04:57.062082 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3ce49243-1d56-4b51-af7e-aa32434607ef tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:57.064210 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3ce49243-1d56-4b51-af7e-aa32434607ef tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:57.085576 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3ce49243-1d56-4b51-af7e-aa32434607ef tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:57.085927 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3ce49243-1d56-4b51-af7e-aa32434607ef tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:57.086724 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3ce49243-1d56-4b51-af7e-aa32434607ef tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:57.087191 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3ce49243-1d56-4b51-af7e-aa32434607ef tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:57.183146 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3ce49243-1d56-4b51-af7e-aa32434607ef tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.125044 Jan 19 16:04:57.183997 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 254/482] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:57 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:57.459690 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-817bf000-5530-4f54-be1d-f3bf09cdc104 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:57.461253 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-817bf000-5530-4f54-be1d-f3bf09cdc104 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:57.470365 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-817bf000-5530-4f54-be1d-f3bf09cdc104 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:57.475547 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-817bf000-5530-4f54-be1d-f3bf09cdc104 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:57.475547 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-817bf000-5530-4f54-be1d-f3bf09cdc104 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:57.475547 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-817bf000-5530-4f54-be1d-f3bf09cdc104 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:57.475886 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-2ead9a61-4896-478a-985e-f894965acd14 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Flavor limits 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:04:57.475886 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-2ead9a61-4896-478a-985e-f894965acd14 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Image limits 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:04:57.475886 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-2ead9a61-4896-478a-985e-f894965acd14 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Flavor pref 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:04:57.475886 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-2ead9a61-4896-478a-985e-f894965acd14 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Image pref 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:04:57.478414 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-2ead9a61-4896-478a-985e-f894965acd14 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:04:57.489079 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2ead9a61-4896-478a-985e-f894965acd14 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:57.489864 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2ead9a61-4896-478a-985e-f894965acd14 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:57.490891 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2ead9a61-4896-478a-985e-f894965acd14 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:57.492393 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2ead9a61-4896-478a-985e-f894965acd14 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:57.529454 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-2ead9a61-4896-478a-985e-f894965acd14 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Getting quotas for project ee1086833404449a901e9a13cc93c8b5. Resources: {'ram', 'cores', 'instances'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:04:57.535571 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-2ead9a61-4896-478a-985e-f894965acd14 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Getting quotas for user 054c8acefa4240469678db612ea73c33 and project ee1086833404449a901e9a13cc93c8b5. Resources: {'ram', 'cores', 'instances'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:04:57.605356 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-2ead9a61-4896-478a-985e-f894965acd14 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Going to run 1 instances... {{(pid=128875) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:04:57.607595 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-2ead9a61-4896-478a-985e-f894965acd14 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0edf87cf-f4af-45e4-8536-eb0bd6710999',volume_size=None,volume_type=None)] {{(pid=128875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:04:57.660654 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-817bf000-5530-4f54-be1d-f3bf09cdc104 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:57.668234 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-817bf000-5530-4f54-be1d-f3bf09cdc104 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9" status: 200 len: 1506 microversion: 2.1 time: 0.213179 Jan 19 16:04:57.668803 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 255/483] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:57 2022] GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9 => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:04:57.737427 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-7873178f-6437-4845-9aff-8b1a337fbd49 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:57.737427 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-7873178f-6437-4845-9aff-8b1a337fbd49 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:57.743744 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7873178f-6437-4845-9aff-8b1a337fbd49 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:57.744529 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7873178f-6437-4845-9aff-8b1a337fbd49 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:57.745703 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7873178f-6437-4845-9aff-8b1a337fbd49 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:57.746344 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7873178f-6437-4845-9aff-8b1a337fbd49 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:57.776270 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-7873178f-6437-4845-9aff-8b1a337fbd49 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] Going to try to terminate instance {{(pid=128876) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:04:58.211817 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-2ead9a61-4896-478a-985e-f894965acd14 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.305766 Jan 19 16:04:58.215116 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 229/484] 10.222.0.58 () {60 vars in 1146 bytes} [Wed Jan 19 16:04:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 1307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:04:58.223539 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-0c014291-d8d4-4113-b2d7-71768fbc371e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:58.225365 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-0c014291-d8d4-4113-b2d7-71768fbc371e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:58.246500 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0c014291-d8d4-4113-b2d7-71768fbc371e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:58.247241 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0c014291-d8d4-4113-b2d7-71768fbc371e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:58.248219 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0c014291-d8d4-4113-b2d7-71768fbc371e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:58.248806 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0c014291-d8d4-4113-b2d7-71768fbc371e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:58.277514 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-7873178f-6437-4845-9aff-8b1a337fbd49 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc" status: 204 len: 0 microversion: 2.1 time: 0.546399 Jan 19 16:04:58.278175 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 256/485] 10.222.0.58 () {58 vars in 1238 bytes} [Wed Jan 19 16:04:57 2022] DELETE /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 19 16:04:58.284436 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f2178f87-24c7-4756-bf14-12a7658eaa6c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:58.287394 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f2178f87-24c7-4756-bf14-12a7658eaa6c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:58.294587 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f2178f87-24c7-4756-bf14-12a7658eaa6c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:58.295235 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f2178f87-24c7-4756-bf14-12a7658eaa6c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:58.296151 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f2178f87-24c7-4756-bf14-12a7658eaa6c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:58.296641 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f2178f87-24c7-4756-bf14-12a7658eaa6c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:58.331190 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-0c014291-d8d4-4113-b2d7-71768fbc371e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.116219 Jan 19 16:04:58.331865 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 230/486] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:58 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:04:58.342066 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-81cd9bd0-6349-4f29-949d-23d605a317e7 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:58.343110 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-81cd9bd0-6349-4f29-949d-23d605a317e7 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:58.374733 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f2178f87-24c7-4756-bf14-12a7658eaa6c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.094916 Jan 19 16:04:58.376506 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 257/487] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:58 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:58.385186 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3597bcf8-5512-450f-8996-d15cb33d192d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:58.386525 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3597bcf8-5512-450f-8996-d15cb33d192d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:58.398528 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3597bcf8-5512-450f-8996-d15cb33d192d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:58.399118 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3597bcf8-5512-450f-8996-d15cb33d192d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:58.405254 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3597bcf8-5512-450f-8996-d15cb33d192d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:58.405254 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3597bcf8-5512-450f-8996-d15cb33d192d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:58.415619 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-81cd9bd0-6349-4f29-949d-23d605a317e7 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:58.424231 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-81cd9bd0-6349-4f29-949d-23d605a317e7 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1094 microversion: 2.1 time: 0.090994 Jan 19 16:04:58.424821 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 231/488] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:58 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1094 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:58.564007 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-3597bcf8-5512-450f-8996-d15cb33d192d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:58.572677 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3597bcf8-5512-450f-8996-d15cb33d192d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc" status: 200 len: 1503 microversion: 2.1 time: 0.194412 Jan 19 16:04:58.573545 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 258/489] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:58 2022] GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc => generated 1503 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:59.346544 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-5e7e7817-5b3c-4d70-adbe-23590378d991 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:59.347690 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-5e7e7817-5b3c-4d70-adbe-23590378d991 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:59.356785 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5e7e7817-5b3c-4d70-adbe-23590378d991 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:59.357603 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5e7e7817-5b3c-4d70-adbe-23590378d991 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:59.358805 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5e7e7817-5b3c-4d70-adbe-23590378d991 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:59.359374 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5e7e7817-5b3c-4d70-adbe-23590378d991 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:59.395067 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-371f5dda-7b89-4cb0-9e63-6695a9b3eb6f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:04:59.396621 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-371f5dda-7b89-4cb0-9e63-6695a9b3eb6f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:59.407962 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-371f5dda-7b89-4cb0-9e63-6695a9b3eb6f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:59.408442 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-371f5dda-7b89-4cb0-9e63-6695a9b3eb6f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:59.409220 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-371f5dda-7b89-4cb0-9e63-6695a9b3eb6f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:59.409657 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-371f5dda-7b89-4cb0-9e63-6695a9b3eb6f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:59.477775 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-5e7e7817-5b3c-4d70-adbe-23590378d991 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.137571 Jan 19 16:04:59.478419 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 232/490] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:04:59 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:04:59.483541 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-eafbf7b3-80cb-461a-ad29-95249acba12a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:59.484235 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-eafbf7b3-80cb-461a-ad29-95249acba12a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:59.492007 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-eafbf7b3-80cb-461a-ad29-95249acba12a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:59.492456 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-eafbf7b3-80cb-461a-ad29-95249acba12a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:59.493251 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-eafbf7b3-80cb-461a-ad29-95249acba12a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:59.493680 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-eafbf7b3-80cb-461a-ad29-95249acba12a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:59.513762 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-371f5dda-7b89-4cb0-9e63-6695a9b3eb6f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.123278 Jan 19 16:04:59.515049 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 259/491] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:04:59 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:04:59.595872 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e8ebedf5-9d48-4fbc-b3cb-74aca90c8262 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:04:59.596516 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-e8ebedf5-9d48-4fbc-b3cb-74aca90c8262 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:04:59.603321 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e8ebedf5-9d48-4fbc-b3cb-74aca90c8262 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:59.603767 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e8ebedf5-9d48-4fbc-b3cb-74aca90c8262 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:59.604562 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e8ebedf5-9d48-4fbc-b3cb-74aca90c8262 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:04:59.605059 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-eafbf7b3-80cb-461a-ad29-95249acba12a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:59.605378 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e8ebedf5-9d48-4fbc-b3cb-74aca90c8262 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:04:59.621522 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-eafbf7b3-80cb-461a-ad29-95249acba12a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1144 microversion: 2.1 time: 0.141068 Jan 19 16:04:59.622899 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 233/492] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:59 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1144 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:04:59.813183 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e8ebedf5-9d48-4fbc-b3cb-74aca90c8262 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:04:59.827877 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e8ebedf5-9d48-4fbc-b3cb-74aca90c8262 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc" status: 200 len: 1503 microversion: 2.1 time: 0.240125 Jan 19 16:04:59.828502 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 260/493] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:04:59 2022] GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc => generated 1503 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:05:00.491031 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-3e1da5ff-48ba-470c-838e-574ce80c188c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:00.491957 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-3e1da5ff-48ba-470c-838e-574ce80c188c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:00.498489 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3e1da5ff-48ba-470c-838e-574ce80c188c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:00.498930 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3e1da5ff-48ba-470c-838e-574ce80c188c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:00.499761 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3e1da5ff-48ba-470c-838e-574ce80c188c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:00.500276 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3e1da5ff-48ba-470c-838e-574ce80c188c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:00.529347 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-0043b4de-b51a-437f-8ea7-7646cdf705c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:00.531392 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-0043b4de-b51a-437f-8ea7-7646cdf705c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:00.541044 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0043b4de-b51a-437f-8ea7-7646cdf705c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:00.544617 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0043b4de-b51a-437f-8ea7-7646cdf705c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:00.544617 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0043b4de-b51a-437f-8ea7-7646cdf705c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:00.544617 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0043b4de-b51a-437f-8ea7-7646cdf705c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:00.675031 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-0043b4de-b51a-437f-8ea7-7646cdf705c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.150634 Jan 19 16:05:00.677125 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 261/494] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:00 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:05:00.682031 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ea5e8ccc-dab7-45ee-8b27-9da5739661ae tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:00.682692 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ea5e8ccc-dab7-45ee-8b27-9da5739661ae tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:00.690383 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ea5e8ccc-dab7-45ee-8b27-9da5739661ae tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:00.691084 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ea5e8ccc-dab7-45ee-8b27-9da5739661ae tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:00.691895 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ea5e8ccc-dab7-45ee-8b27-9da5739661ae tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:00.692329 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ea5e8ccc-dab7-45ee-8b27-9da5739661ae tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:00.697587 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-3e1da5ff-48ba-470c-838e-574ce80c188c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.208124 Jan 19 16:05:00.703130 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 234/495] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:00 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:05:00.765277 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ea5e8ccc-dab7-45ee-8b27-9da5739661ae tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:00.776179 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ea5e8ccc-dab7-45ee-8b27-9da5739661ae tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1192 microversion: 2.1 time: 0.097800 Jan 19 16:05:00.776859 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 262/496] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:00 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1192 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:00.847519 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-93bfca55-f5c4-440a-a1af-2c6d6cd19d56 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:00.848793 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-93bfca55-f5c4-440a-a1af-2c6d6cd19d56 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:00.857297 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-93bfca55-f5c4-440a-a1af-2c6d6cd19d56 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:00.857845 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-93bfca55-f5c4-440a-a1af-2c6d6cd19d56 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:00.858648 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-93bfca55-f5c4-440a-a1af-2c6d6cd19d56 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:00.859146 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-93bfca55-f5c4-440a-a1af-2c6d6cd19d56 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:00.901055 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-5aa06794-db14-48b1-b603-1d829329fd53 req-f222d582-9d03-4c60-8c70-2ea9d9bc2031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8efdc25-ba11-4f86-8383-4bc10280edbc", "name": "network-vif-deleted", "tag": "56d9765d-44b0-4cba-9c25-f5408ceb4492"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:00.904927 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:05:00.904927 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:05:00.916625 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-5aa06794-db14-48b1-b603-1d829329fd53 req-f222d582-9d03-4c60-8c70-2ea9d9bc2031 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:00.917088 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-5aa06794-db14-48b1-b603-1d829329fd53 req-f222d582-9d03-4c60-8c70-2ea9d9bc2031 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:00.930754 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-5aa06794-db14-48b1-b603-1d829329fd53 req-f222d582-9d03-4c60-8c70-2ea9d9bc2031 service nova] Creating event network-vif-deleted:56d9765d-44b0-4cba-9c25-f5408ceb4492 for instance c8efdc25-ba11-4f86-8383-4bc10280edbc on hv-cinder-82002 Jan 19 16:05:00.937525 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-5aa06794-db14-48b1-b603-1d829329fd53 req-f222d582-9d03-4c60-8c70-2ea9d9bc2031 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040769 Jan 19 16:05:00.939718 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 263/497] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:05:00.956135 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-93bfca55-f5c4-440a-a1af-2c6d6cd19d56 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:00.966190 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-93bfca55-f5c4-440a-a1af-2c6d6cd19d56 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc" status: 200 len: 1461 microversion: 2.1 time: 0.123660 Jan 19 16:05:00.967022 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 235/498] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:00 2022] GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc => generated 1461 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:01.688099 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-91693292-4319-4865-8ff9-bf88f3c4cc7d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:01.691715 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-91693292-4319-4865-8ff9-bf88f3c4cc7d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:01.701253 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-91693292-4319-4865-8ff9-bf88f3c4cc7d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:01.701698 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-91693292-4319-4865-8ff9-bf88f3c4cc7d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:01.702637 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-91693292-4319-4865-8ff9-bf88f3c4cc7d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:01.703161 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-91693292-4319-4865-8ff9-bf88f3c4cc7d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:01.715570 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-37024cca-57f2-4330-b693-7e58ab5520ec tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:01.717537 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-37024cca-57f2-4330-b693-7e58ab5520ec tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:01.726716 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-37024cca-57f2-4330-b693-7e58ab5520ec tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:01.727399 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-37024cca-57f2-4330-b693-7e58ab5520ec tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:01.730880 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-37024cca-57f2-4330-b693-7e58ab5520ec tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:01.730880 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-37024cca-57f2-4330-b693-7e58ab5520ec tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:01.823757 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-91693292-4319-4865-8ff9-bf88f3c4cc7d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.139719 Jan 19 16:05:01.828135 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 264/499] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:01 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:05:01.835118 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-cbf8e62e-e483-478e-8aa2-6358c6eb646a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:01.835978 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-cbf8e62e-e483-478e-8aa2-6358c6eb646a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:01.839701 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-37024cca-57f2-4330-b693-7e58ab5520ec tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.128525 Jan 19 16:05:01.841335 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 236/500] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:01 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:05:01.849194 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cbf8e62e-e483-478e-8aa2-6358c6eb646a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:01.850123 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cbf8e62e-e483-478e-8aa2-6358c6eb646a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:01.854900 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cbf8e62e-e483-478e-8aa2-6358c6eb646a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:01.855670 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cbf8e62e-e483-478e-8aa2-6358c6eb646a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:01.931868 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-cbf8e62e-e483-478e-8aa2-6358c6eb646a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:01.940850 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-cbf8e62e-e483-478e-8aa2-6358c6eb646a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1210 microversion: 2.1 time: 0.114200 Jan 19 16:05:01.941898 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 265/501] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:01 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1210 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:01.985344 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-59c0d269-e498-4c7d-a6fd-1ea47c1563db tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:01.986320 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-59c0d269-e498-4c7d-a6fd-1ea47c1563db tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:01.994243 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-59c0d269-e498-4c7d-a6fd-1ea47c1563db tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:01.994697 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-59c0d269-e498-4c7d-a6fd-1ea47c1563db tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:01.995907 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-59c0d269-e498-4c7d-a6fd-1ea47c1563db tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:01.996403 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-59c0d269-e498-4c7d-a6fd-1ea47c1563db tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:02.033738 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-59c0d269-e498-4c7d-a6fd-1ea47c1563db tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:02.034180 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-59c0d269-e498-4c7d-a6fd-1ea47c1563db tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:02.034632 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.objects.instance [None req-59c0d269-e498-4c7d-a6fd-1ea47c1563db tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lazy-loading 'fault' on Instance uuid c8efdc25-ba11-4f86-8383-4bc10280edbc {{(pid=128875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:05:02.078225 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-59c0d269-e498-4c7d-a6fd-1ea47c1563db tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:02.086993 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-59c0d269-e498-4c7d-a6fd-1ea47c1563db tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc" status: 200 len: 1304 microversion: 2.1 time: 0.106802 Jan 19 16:05:02.097569 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 237/502] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:01 2022] GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:05:02.488646 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-bcccfd2f-f9b6-4a26-b47a-b89778bfa900 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:02.489556 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-bcccfd2f-f9b6-4a26-b47a-b89778bfa900 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:02.496614 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bcccfd2f-f9b6-4a26-b47a-b89778bfa900 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:02.497049 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bcccfd2f-f9b6-4a26-b47a-b89778bfa900 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:02.501581 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bcccfd2f-f9b6-4a26-b47a-b89778bfa900 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:02.501581 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bcccfd2f-f9b6-4a26-b47a-b89778bfa900 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:02.527975 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.objects.instance [None req-bcccfd2f-f9b6-4a26-b47a-b89778bfa900 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lazy-loading 'flavor' on Instance uuid 808abc0b-bb27-496f-8ce0-d536ab3d1ffb {{(pid=128876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:05:02.835610 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-3a6147a8-4630-4789-b6e0-217ccb98764a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:02.836525 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-3a6147a8-4630-4789-b6e0-217ccb98764a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:02.846184 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3a6147a8-4630-4789-b6e0-217ccb98764a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:02.848979 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3a6147a8-4630-4789-b6e0-217ccb98764a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:02.850107 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3a6147a8-4630-4789-b6e0-217ccb98764a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:02.850750 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3a6147a8-4630-4789-b6e0-217ccb98764a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:02.964512 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-3a6147a8-4630-4789-b6e0-217ccb98764a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.132386 Jan 19 16:05:02.970284 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-bcccfd2f-f9b6-4a26-b47a-b89778bfa900 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "POST /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/action" status: 200 len: 32 microversion: 2.1 time: 0.483417 Jan 19 16:05:02.986048 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 238/503] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:02 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:05:02.986287 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 266/504] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:02 2022] POST /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/action => generated 32 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:05:02.995392 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-b106d1c8-3074-4021-9724-5a310faa13c4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:02.996912 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-b106d1c8-3074-4021-9724-5a310faa13c4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:02.998504 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e20e03bd-980e-4226-bab4-8621bc4af6a2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:03.000910 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-e20e03bd-980e-4226-bab4-8621bc4af6a2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:03.005324 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b106d1c8-3074-4021-9724-5a310faa13c4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:03.006217 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b106d1c8-3074-4021-9724-5a310faa13c4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:03.007781 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b106d1c8-3074-4021-9724-5a310faa13c4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:03.008232 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b106d1c8-3074-4021-9724-5a310faa13c4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:03.013623 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e20e03bd-980e-4226-bab4-8621bc4af6a2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:03.014427 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e20e03bd-980e-4226-bab4-8621bc4af6a2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:03.016088 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e20e03bd-980e-4226-bab4-8621bc4af6a2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:03.017270 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e20e03bd-980e-4226-bab4-8621bc4af6a2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:03.102622 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-b106d1c8-3074-4021-9724-5a310faa13c4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.120735 Jan 19 16:05:03.104476 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 239/505] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:02 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:05:03.114269 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d16685f4-7f16-4007-8691-c12ba0cd708b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:03.115883 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d16685f4-7f16-4007-8691-c12ba0cd708b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:03.131224 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d16685f4-7f16-4007-8691-c12ba0cd708b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:03.132319 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d16685f4-7f16-4007-8691-c12ba0cd708b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:03.134013 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d16685f4-7f16-4007-8691-c12ba0cd708b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:03.135007 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d16685f4-7f16-4007-8691-c12ba0cd708b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:03.316593 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e20e03bd-980e-4226-bab4-8621bc4af6a2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:03.324954 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e20e03bd-980e-4226-bab4-8621bc4af6a2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1277 microversion: 2.1 time: 0.340343 Jan 19 16:05:03.325902 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 267/506] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:02 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1277 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:03.331232 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b2d2470f-ae73-4738-a200-184233a5484c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:03.337890 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b2d2470f-ae73-4738-a200-184233a5484c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: c8efdc25-ba11-4f86-8383-4bc10280edbc] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:03.346478 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b2d2470f-ae73-4738-a200-184233a5484c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:03.347304 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b2d2470f-ae73-4738-a200-184233a5484c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:03.348287 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b2d2470f-ae73-4738-a200-184233a5484c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:03.349570 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b2d2470f-ae73-4738-a200-184233a5484c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:03.372578 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.wsgi [None req-b2d2470f-ae73-4738-a200-184233a5484c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] HTTP exception thrown: Instance c8efdc25-ba11-4f86-8383-4bc10280edbc could not be found. Jan 19 16:05:03.373783 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b2d2470f-ae73-4738-a200-184233a5484c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Returning 404 to user: Instance c8efdc25-ba11-4f86-8383-4bc10280edbc could not be found. {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:05:03.374935 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b2d2470f-ae73-4738-a200-184233a5484c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc" status: 404 len: 111 microversion: 2.1 time: 0.048081 Jan 19 16:05:03.379722 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 268/507] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:03 2022] GET /compute/v2.1/servers/c8efdc25-ba11-4f86-8383-4bc10280edbc => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:05:03.389057 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-5792fbb3-188d-484b-9a9b-b3c707609023 req-ff2157e7-c60b-46a8-99ad-2957dd76a076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a199868-949d-49fb-96e3-8c0befc8e20b", "tag": "31d41df4-bb41-486f-bc2f-3fbe182757f0"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:03.392175 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:05:03.392175 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:05:03.403499 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-5792fbb3-188d-484b-9a9b-b3c707609023 req-ff2157e7-c60b-46a8-99ad-2957dd76a076 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:03.404883 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-5792fbb3-188d-484b-9a9b-b3c707609023 req-ff2157e7-c60b-46a8-99ad-2957dd76a076 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:03.421315 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-5792fbb3-188d-484b-9a9b-b3c707609023 req-ff2157e7-c60b-46a8-99ad-2957dd76a076 service nova] Creating event network-changed:31d41df4-bb41-486f-bc2f-3fbe182757f0 for instance 2a199868-949d-49fb-96e3-8c0befc8e20b on hv-cinder-82002 Jan 19 16:05:03.429007 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-5792fbb3-188d-484b-9a9b-b3c707609023 req-ff2157e7-c60b-46a8-99ad-2957dd76a076 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047608 Jan 19 16:05:03.429696 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 269/508] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:05:03.537696 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-9a636aa3-8d24-4b6b-bcec-30dc1c2bfe19 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-434954423", "imageRef": "6d9c05bd-015a-44de-bd51-f744cb247e7a", "flavorRef": "452", "networks": [{"uuid": "165e0cd2-7a89-43fa-bef6-46f81611384f"}]}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:03.600394 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.network.neutron [None req-9a636aa3-8d24-4b6b-bcec-30dc1c2bfe19 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] validate_networks() for [('165e0cd2-7a89-43fa-bef6-46f81611384f', None, None, None, None, None)] {{(pid=128876) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:05:03.679169 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d16685f4-7f16-4007-8691-c12ba0cd708b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:03.705892 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d16685f4-7f16-4007-8691-c12ba0cd708b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1565 microversion: 2.1 time: 0.599551 Jan 19 16:05:03.715578 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 240/509] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:03 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1565 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:03.990576 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-0f563731-2447-4af5-8afe-e7910f02e162 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:03.991570 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-0f563731-2447-4af5-8afe-e7910f02e162 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:04.003352 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0f563731-2447-4af5-8afe-e7910f02e162 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:04.003812 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0f563731-2447-4af5-8afe-e7910f02e162 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:04.004622 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0f563731-2447-4af5-8afe-e7910f02e162 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:04.005063 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0f563731-2447-4af5-8afe-e7910f02e162 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:04.085454 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-0f563731-2447-4af5-8afe-e7910f02e162 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.098747 Jan 19 16:05:04.086748 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 241/510] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:03 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:05:04.096187 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-9a636aa3-8d24-4b6b-bcec-30dc1c2bfe19 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Flavor limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:05:04.097789 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-9a636aa3-8d24-4b6b-bcec-30dc1c2bfe19 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Image limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:05:04.098939 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-9a636aa3-8d24-4b6b-bcec-30dc1c2bfe19 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Flavor pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:05:04.100266 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-9a636aa3-8d24-4b6b-bcec-30dc1c2bfe19 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Image pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:05:04.101224 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-9a636aa3-8d24-4b6b-bcec-30dc1c2bfe19 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:05:04.118667 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-40820498-f7e2-4c81-a061-c282e77c69a7 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:04.119823 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-40820498-f7e2-4c81-a061-c282e77c69a7 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:04.121588 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9a636aa3-8d24-4b6b-bcec-30dc1c2bfe19 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:04.122665 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9a636aa3-8d24-4b6b-bcec-30dc1c2bfe19 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:04.125404 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9a636aa3-8d24-4b6b-bcec-30dc1c2bfe19 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:04.127192 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9a636aa3-8d24-4b6b-bcec-30dc1c2bfe19 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:04.129171 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-40820498-f7e2-4c81-a061-c282e77c69a7 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:04.129630 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-40820498-f7e2-4c81-a061-c282e77c69a7 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:04.130854 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-40820498-f7e2-4c81-a061-c282e77c69a7 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:04.131403 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-40820498-f7e2-4c81-a061-c282e77c69a7 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:04.163486 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-9a636aa3-8d24-4b6b-bcec-30dc1c2bfe19 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Getting quotas for project 32d0fa3bcd1c4abda9016798b037bf1f. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:05:04.192183 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-9a636aa3-8d24-4b6b-bcec-30dc1c2bfe19 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Getting quotas for user 80c9613f79684051a2f0465852b5bfed and project 32d0fa3bcd1c4abda9016798b037bf1f. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:05:04.220278 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-9a636aa3-8d24-4b6b-bcec-30dc1c2bfe19 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Going to run 1 instances... {{(pid=128876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:05:04.227802 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-9a636aa3-8d24-4b6b-bcec-30dc1c2bfe19 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6d9c05bd-015a-44de-bd51-f744cb247e7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:05:04.263343 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-40820498-f7e2-4c81-a061-c282e77c69a7 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.141231 Jan 19 16:05:04.266472 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 242/511] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:04 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:05:04.347156 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-641ed066-c0be-44de-8641-d22835ac6632 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:04.347768 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-641ed066-c0be-44de-8641-d22835ac6632 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:04.355316 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-641ed066-c0be-44de-8641-d22835ac6632 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:04.355892 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-641ed066-c0be-44de-8641-d22835ac6632 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:04.356750 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-641ed066-c0be-44de-8641-d22835ac6632 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:04.357164 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-641ed066-c0be-44de-8641-d22835ac6632 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:04.359394 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-9a636aa3-8d24-4b6b-bcec-30dc1c2bfe19 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.825651 Jan 19 16:05:04.365098 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 270/512] 10.222.0.58 () {60 vars in 1146 bytes} [Wed Jan 19 16:05:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 19 16:05:04.371026 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3c85e520-a1c4-4c13-8075-cd965735787e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:04.371840 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3c85e520-a1c4-4c13-8075-cd965735787e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:04.432965 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-3c85e520-a1c4-4c13-8075-cd965735787e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:04.440449 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3c85e520-a1c4-4c13-8075-cd965735787e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1213 microversion: 2.1 time: 0.073304 Jan 19 16:05:04.442882 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 271/513] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:04 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:05:04.653797 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-641ed066-c0be-44de-8641-d22835ac6632 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:04.665233 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-641ed066-c0be-44de-8641-d22835ac6632 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1277 microversion: 2.1 time: 0.322605 Jan 19 16:05:04.665966 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 243/514] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:04 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1277 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:05:04.724337 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5a098364-d629-469f-9657-6aa550972fb8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:04.725021 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5a098364-d629-469f-9657-6aa550972fb8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:04.734946 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5a098364-d629-469f-9657-6aa550972fb8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:04.735775 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5a098364-d629-469f-9657-6aa550972fb8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:04.736603 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5a098364-d629-469f-9657-6aa550972fb8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:04.737032 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5a098364-d629-469f-9657-6aa550972fb8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:04.901086 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5a098364-d629-469f-9657-6aa550972fb8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:04.912359 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5a098364-d629-469f-9657-6aa550972fb8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1565 microversion: 2.1 time: 0.192052 Jan 19 16:05:04.914252 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 272/515] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:04 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1565 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:05.100067 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-07857f8c-dadf-4766-adfd-d8fc35b5e3d4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:05.101343 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-07857f8c-dadf-4766-adfd-d8fc35b5e3d4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:05.108598 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-07857f8c-dadf-4766-adfd-d8fc35b5e3d4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:05.109326 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-07857f8c-dadf-4766-adfd-d8fc35b5e3d4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:05.110916 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-07857f8c-dadf-4766-adfd-d8fc35b5e3d4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:05.111302 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-07857f8c-dadf-4766-adfd-d8fc35b5e3d4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:05.203548 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-07857f8c-dadf-4766-adfd-d8fc35b5e3d4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.107216 Jan 19 16:05:05.204221 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 244/516] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:05 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:05:05.277162 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-1cdb44a7-54df-49b5-b333-da814c7f3d2b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:05.278187 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-1cdb44a7-54df-49b5-b333-da814c7f3d2b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:05.286237 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1cdb44a7-54df-49b5-b333-da814c7f3d2b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:05.286907 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1cdb44a7-54df-49b5-b333-da814c7f3d2b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:05.287729 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1cdb44a7-54df-49b5-b333-da814c7f3d2b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:05.288161 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1cdb44a7-54df-49b5-b333-da814c7f3d2b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:05.362269 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-1cdb44a7-54df-49b5-b333-da814c7f3d2b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.089172 Jan 19 16:05:05.362845 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 273/517] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:05 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:05:05.457744 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-193e1273-3b0b-4658-8cd3-e581d89328aa tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:05.458457 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-193e1273-3b0b-4658-8cd3-e581d89328aa tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:05.468066 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-193e1273-3b0b-4658-8cd3-e581d89328aa tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:05.468512 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-193e1273-3b0b-4658-8cd3-e581d89328aa tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:05.469955 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-193e1273-3b0b-4658-8cd3-e581d89328aa tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:05.470373 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-193e1273-3b0b-4658-8cd3-e581d89328aa tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:05.531612 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-193e1273-3b0b-4658-8cd3-e581d89328aa tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:05.539870 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-193e1273-3b0b-4658-8cd3-e581d89328aa tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1217 microversion: 2.1 time: 0.086758 Jan 19 16:05:05.540453 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 245/518] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:05 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:05.682394 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-849420d0-747e-4e13-86a4-343d5016c522 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:05.683186 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-849420d0-747e-4e13-86a4-343d5016c522 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:05.691391 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-849420d0-747e-4e13-86a4-343d5016c522 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:05.691873 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-849420d0-747e-4e13-86a4-343d5016c522 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:05.692671 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-849420d0-747e-4e13-86a4-343d5016c522 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:05.693102 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-849420d0-747e-4e13-86a4-343d5016c522 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:05.847227 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-849420d0-747e-4e13-86a4-343d5016c522 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:05.855271 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-849420d0-747e-4e13-86a4-343d5016c522 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1277 microversion: 2.1 time: 0.176811 Jan 19 16:05:05.855939 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 274/519] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:05 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:05.931977 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-4471e63a-db5d-49d8-9751-9f090ff3fc5f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:05.932571 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-4471e63a-db5d-49d8-9751-9f090ff3fc5f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:05.940474 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4471e63a-db5d-49d8-9751-9f090ff3fc5f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:05.940919 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4471e63a-db5d-49d8-9751-9f090ff3fc5f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:05.941701 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4471e63a-db5d-49d8-9751-9f090ff3fc5f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:05.942127 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4471e63a-db5d-49d8-9751-9f090ff3fc5f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:06.106364 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-4471e63a-db5d-49d8-9751-9f090ff3fc5f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:06.115881 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-4471e63a-db5d-49d8-9751-9f090ff3fc5f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1565 microversion: 2.1 time: 0.187468 Jan 19 16:05:06.116492 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 246/520] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:05 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1565 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:06.222408 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-db0cd0bf-a2b1-48a6-ae72-02e20c1adfc6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:06.223262 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-db0cd0bf-a2b1-48a6-ae72-02e20c1adfc6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:06.229622 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-db0cd0bf-a2b1-48a6-ae72-02e20c1adfc6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:06.230058 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-db0cd0bf-a2b1-48a6-ae72-02e20c1adfc6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:06.230832 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-db0cd0bf-a2b1-48a6-ae72-02e20c1adfc6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:06.231296 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-db0cd0bf-a2b1-48a6-ae72-02e20c1adfc6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:06.303691 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-db0cd0bf-a2b1-48a6-ae72-02e20c1adfc6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.084979 Jan 19 16:05:06.305718 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 275/521] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:06 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:05:06.373756 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e97205d9-8ed3-41a3-bd1b-83c6adc68f91 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:06.374709 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-e97205d9-8ed3-41a3-bd1b-83c6adc68f91 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:06.385598 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e97205d9-8ed3-41a3-bd1b-83c6adc68f91 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:06.385998 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e97205d9-8ed3-41a3-bd1b-83c6adc68f91 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:06.386818 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e97205d9-8ed3-41a3-bd1b-83c6adc68f91 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:06.387236 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e97205d9-8ed3-41a3-bd1b-83c6adc68f91 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:06.498086 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e97205d9-8ed3-41a3-bd1b-83c6adc68f91 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.127689 Jan 19 16:05:06.498791 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 247/522] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:06 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:05:06.558094 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a4a347f8-9f0d-4282-ab70-77a1c4a978a1 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:06.559939 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a4a347f8-9f0d-4282-ab70-77a1c4a978a1 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:06.570557 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a4a347f8-9f0d-4282-ab70-77a1c4a978a1 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:06.571123 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a4a347f8-9f0d-4282-ab70-77a1c4a978a1 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:06.571937 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a4a347f8-9f0d-4282-ab70-77a1c4a978a1 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:06.572464 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a4a347f8-9f0d-4282-ab70-77a1c4a978a1 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:06.647474 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a4a347f8-9f0d-4282-ab70-77a1c4a978a1 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:06.655132 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a4a347f8-9f0d-4282-ab70-77a1c4a978a1 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1265 microversion: 2.1 time: 0.101127 Jan 19 16:05:06.655728 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 276/523] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:06 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1265 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:06.872740 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-05a05e3a-5d77-4801-8e3f-b420fc9470af tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:06.873645 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-05a05e3a-5d77-4801-8e3f-b420fc9470af tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:06.881549 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-05a05e3a-5d77-4801-8e3f-b420fc9470af tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:06.882246 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-05a05e3a-5d77-4801-8e3f-b420fc9470af tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:06.883189 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-05a05e3a-5d77-4801-8e3f-b420fc9470af tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:06.883738 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-05a05e3a-5d77-4801-8e3f-b420fc9470af tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:07.132607 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-42eac7d0-5117-4375-9c8a-60d49c7baa20 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:07.133585 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-42eac7d0-5117-4375-9c8a-60d49c7baa20 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:07.141611 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-42eac7d0-5117-4375-9c8a-60d49c7baa20 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:07.142430 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-42eac7d0-5117-4375-9c8a-60d49c7baa20 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:07.143362 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-42eac7d0-5117-4375-9c8a-60d49c7baa20 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:07.143887 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-42eac7d0-5117-4375-9c8a-60d49c7baa20 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:07.164373 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-05a05e3a-5d77-4801-8e3f-b420fc9470af tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:07.173138 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-05a05e3a-5d77-4801-8e3f-b420fc9470af tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1277 microversion: 2.1 time: 0.304395 Jan 19 16:05:07.183546 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 248/524] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:06 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1277 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:07.307050 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-42eac7d0-5117-4375-9c8a-60d49c7baa20 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:07.315964 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-42eac7d0-5117-4375-9c8a-60d49c7baa20 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1565 microversion: 2.1 time: 0.187088 Jan 19 16:05:07.316592 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 277/525] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:07 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1565 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:05:07.322140 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-8799413f-6d78-428f-a334-727508c4be4c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:07.322140 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8799413f-6d78-428f-a334-727508c4be4c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:07.330484 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8799413f-6d78-428f-a334-727508c4be4c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:07.331584 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8799413f-6d78-428f-a334-727508c4be4c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:07.332998 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8799413f-6d78-428f-a334-727508c4be4c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:07.333790 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8799413f-6d78-428f-a334-727508c4be4c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:07.444648 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-8799413f-6d78-428f-a334-727508c4be4c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.132089 Jan 19 16:05:07.449474 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 249/526] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:07 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:05:07.509996 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d4373db7-34fc-43d6-8ff7-37c238e7125a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:07.511025 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-d4373db7-34fc-43d6-8ff7-37c238e7125a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:07.517700 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d4373db7-34fc-43d6-8ff7-37c238e7125a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:07.518151 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d4373db7-34fc-43d6-8ff7-37c238e7125a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:07.519196 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d4373db7-34fc-43d6-8ff7-37c238e7125a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:07.519411 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d4373db7-34fc-43d6-8ff7-37c238e7125a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:07.591466 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-d4373db7-34fc-43d6-8ff7-37c238e7125a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.085066 Jan 19 16:05:07.592225 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 278/527] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:07 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:05:07.674241 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ce8c99f8-7c0c-4717-b956-85f7fb386a1c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:07.675018 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-ce8c99f8-7c0c-4717-b956-85f7fb386a1c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:07.682315 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ce8c99f8-7c0c-4717-b956-85f7fb386a1c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:07.682767 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ce8c99f8-7c0c-4717-b956-85f7fb386a1c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:07.683586 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ce8c99f8-7c0c-4717-b956-85f7fb386a1c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:07.684018 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ce8c99f8-7c0c-4717-b956-85f7fb386a1c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:07.759308 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ce8c99f8-7c0c-4717-b956-85f7fb386a1c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:07.767133 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-ce8c99f8-7c0c-4717-b956-85f7fb386a1c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1271 microversion: 2.1 time: 0.097483 Jan 19 16:05:07.767728 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 250/528] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:07 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:08.192668 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8b88929a-b412-4fe3-af3e-7dca1aca28e3 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:08.193436 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-8b88929a-b412-4fe3-af3e-7dca1aca28e3 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:08.200820 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8b88929a-b412-4fe3-af3e-7dca1aca28e3 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:08.201178 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8b88929a-b412-4fe3-af3e-7dca1aca28e3 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:08.201967 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8b88929a-b412-4fe3-af3e-7dca1aca28e3 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:08.202391 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8b88929a-b412-4fe3-af3e-7dca1aca28e3 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:08.333889 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e0f0ab35-c81c-437e-bc61-3baba17954cd tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:08.334699 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-e0f0ab35-c81c-437e-bc61-3baba17954cd tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:08.341512 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e0f0ab35-c81c-437e-bc61-3baba17954cd tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:08.341962 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e0f0ab35-c81c-437e-bc61-3baba17954cd tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:08.342760 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e0f0ab35-c81c-437e-bc61-3baba17954cd tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:08.343224 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e0f0ab35-c81c-437e-bc61-3baba17954cd tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:08.354466 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8b88929a-b412-4fe3-af3e-7dca1aca28e3 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:08.364461 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-8b88929a-b412-4fe3-af3e-7dca1aca28e3 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1277 microversion: 2.1 time: 0.177912 Jan 19 16:05:08.366649 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 279/529] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:08 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:08.459438 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a7205c17-7c94-426a-894c-d083e37fd67f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:08.462179 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a7205c17-7c94-426a-894c-d083e37fd67f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:08.469686 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a7205c17-7c94-426a-894c-d083e37fd67f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:08.474581 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a7205c17-7c94-426a-894c-d083e37fd67f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:08.474581 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a7205c17-7c94-426a-894c-d083e37fd67f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:08.474581 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a7205c17-7c94-426a-894c-d083e37fd67f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:08.600362 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e0f0ab35-c81c-437e-bc61-3baba17954cd tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:08.610783 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a7205c17-7c94-426a-894c-d083e37fd67f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.154942 Jan 19 16:05:08.611778 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 280/530] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:08 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:05:08.617956 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e0f0ab35-c81c-437e-bc61-3baba17954cd tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1565 microversion: 2.1 time: 0.287685 Jan 19 16:05:08.618889 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 251/531] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:08 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1565 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:05:08.635247 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b964447d-5135-45c1-865c-d8299dd9d619 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:08.636660 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b964447d-5135-45c1-865c-d8299dd9d619 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:08.652578 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b964447d-5135-45c1-865c-d8299dd9d619 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:08.653035 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b964447d-5135-45c1-865c-d8299dd9d619 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:08.653969 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b964447d-5135-45c1-865c-d8299dd9d619 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:08.654471 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b964447d-5135-45c1-865c-d8299dd9d619 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:08.725756 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b964447d-5135-45c1-865c-d8299dd9d619 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.112213 Jan 19 16:05:08.726484 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 281/532] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:08 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:05:08.791898 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6ba1f27f-c84b-4aa4-99f3-c927b96c461c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:08.793909 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-6ba1f27f-c84b-4aa4-99f3-c927b96c461c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:08.799327 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6ba1f27f-c84b-4aa4-99f3-c927b96c461c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:08.800081 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6ba1f27f-c84b-4aa4-99f3-c927b96c461c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:08.800865 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6ba1f27f-c84b-4aa4-99f3-c927b96c461c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:08.801888 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6ba1f27f-c84b-4aa4-99f3-c927b96c461c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:08.847450 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-962744ab-ec00-48d1-8252-33de28dabd8d req-fa409aad-cc6e-4a48-b5a8-6f61107bc29d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e48fec90-7f72-4519-b6cf-dfcdc0c8225f", "tag": "f7b41b1e-9a19-457c-8074-1c6e8e142c6e"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:08.850606 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:05:08.850606 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:05:08.860358 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-962744ab-ec00-48d1-8252-33de28dabd8d req-fa409aad-cc6e-4a48-b5a8-6f61107bc29d service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:08.860796 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-962744ab-ec00-48d1-8252-33de28dabd8d req-fa409aad-cc6e-4a48-b5a8-6f61107bc29d service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:08.891939 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-962744ab-ec00-48d1-8252-33de28dabd8d req-fa409aad-cc6e-4a48-b5a8-6f61107bc29d service nova] Creating event network-changed:f7b41b1e-9a19-457c-8074-1c6e8e142c6e for instance e48fec90-7f72-4519-b6cf-dfcdc0c8225f on hv-cinder-82002 Jan 19 16:05:08.900707 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-962744ab-ec00-48d1-8252-33de28dabd8d req-fa409aad-cc6e-4a48-b5a8-6f61107bc29d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068332 Jan 19 16:05:08.901975 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 282/533] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:05:09.025554 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6ba1f27f-c84b-4aa4-99f3-c927b96c461c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:09.036326 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6ba1f27f-c84b-4aa4-99f3-c927b96c461c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1313 microversion: 2.1 time: 0.248208 Jan 19 16:05:09.037338 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 252/534] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:08 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:09.385586 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-43fe041d-2f07-44e0-ac10-e76d36e9407c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:09.386582 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-43fe041d-2f07-44e0-ac10-e76d36e9407c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:09.394233 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-43fe041d-2f07-44e0-ac10-e76d36e9407c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:09.394721 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-43fe041d-2f07-44e0-ac10-e76d36e9407c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:09.395757 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-43fe041d-2f07-44e0-ac10-e76d36e9407c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:09.396290 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-43fe041d-2f07-44e0-ac10-e76d36e9407c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:09.622644 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-1f82b89d-3746-4924-b116-a4a46d9acf2b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:09.623701 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-1f82b89d-3746-4924-b116-a4a46d9acf2b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:09.630330 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1f82b89d-3746-4924-b116-a4a46d9acf2b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:09.630773 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1f82b89d-3746-4924-b116-a4a46d9acf2b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:09.631598 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1f82b89d-3746-4924-b116-a4a46d9acf2b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:09.632026 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1f82b89d-3746-4924-b116-a4a46d9acf2b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:09.645519 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-43fe041d-2f07-44e0-ac10-e76d36e9407c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:09.653293 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-43fe041d-2f07-44e0-ac10-e76d36e9407c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1277 microversion: 2.1 time: 0.274364 Jan 19 16:05:09.653873 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 283/535] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:09 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1277 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:09.670039 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-2961d2bf-f078-4526-9264-98b71b90c31a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:09.670916 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-2961d2bf-f078-4526-9264-98b71b90c31a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:09.680168 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2961d2bf-f078-4526-9264-98b71b90c31a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:09.680611 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2961d2bf-f078-4526-9264-98b71b90c31a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:09.681391 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2961d2bf-f078-4526-9264-98b71b90c31a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:09.681819 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2961d2bf-f078-4526-9264-98b71b90c31a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:09.715985 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-1f82b89d-3746-4924-b116-a4a46d9acf2b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.096325 Jan 19 16:05:09.724071 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 253/536] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:09 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:05:09.746391 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-5ff1d10f-2ed1-4687-b613-4fc5cdf8feb1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:09.747771 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-5ff1d10f-2ed1-4687-b613-4fc5cdf8feb1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:09.760954 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5ff1d10f-2ed1-4687-b613-4fc5cdf8feb1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:09.760954 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5ff1d10f-2ed1-4687-b613-4fc5cdf8feb1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:09.760954 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5ff1d10f-2ed1-4687-b613-4fc5cdf8feb1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:09.760954 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5ff1d10f-2ed1-4687-b613-4fc5cdf8feb1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:09.868631 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-5ff1d10f-2ed1-4687-b613-4fc5cdf8feb1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.122545 Jan 19 16:05:09.873214 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 254/537] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:09 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:05:09.911871 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-2961d2bf-f078-4526-9264-98b71b90c31a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:09.921011 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-2961d2bf-f078-4526-9264-98b71b90c31a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1565 microversion: 2.1 time: 0.255582 Jan 19 16:05:09.922471 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 284/538] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:09 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1565 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:09.969632 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-950d3a8a-6eaa-4a8a-b89c-155e3b197bc7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd6d9866-4086-4986-827a-8b11210b6546"}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:09.970779 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-950d3a8a-6eaa-4a8a-b89c-155e3b197bc7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:09.978304 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-950d3a8a-6eaa-4a8a-b89c-155e3b197bc7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:09.978748 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-950d3a8a-6eaa-4a8a-b89c-155e3b197bc7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:09.979572 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-950d3a8a-6eaa-4a8a-b89c-155e3b197bc7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:09.979997 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-950d3a8a-6eaa-4a8a-b89c-155e3b197bc7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:10.059534 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-de8ecec1-1547-4fb4-81fe-e3b1d7fba5c1 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:10.060503 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-de8ecec1-1547-4fb4-81fe-e3b1d7fba5c1 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:10.070200 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-de8ecec1-1547-4fb4-81fe-e3b1d7fba5c1 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:10.071321 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-de8ecec1-1547-4fb4-81fe-e3b1d7fba5c1 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:10.073010 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-de8ecec1-1547-4fb4-81fe-e3b1d7fba5c1 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:10.073762 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-de8ecec1-1547-4fb4-81fe-e3b1d7fba5c1 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:10.110253 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.wsgi [None req-950d3a8a-6eaa-4a8a-b89c-155e3b197bc7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] HTTP exception thrown: Invalid volume: volume fd6d9866-4086-4986-827a-8b11210b6546 is already attached to instances: ad149c5f-bf90-41d8-b480-18b9dafbd058 Jan 19 16:05:10.110721 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-950d3a8a-6eaa-4a8a-b89c-155e3b197bc7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Returning 400 to user: Invalid volume: volume fd6d9866-4086-4986-827a-8b11210b6546 is already attached to instances: ad149c5f-bf90-41d8-b480-18b9dafbd058 {{(pid=128875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:05:10.111675 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-950d3a8a-6eaa-4a8a-b89c-155e3b197bc7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "POST /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.147526 Jan 19 16:05:10.114631 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 255/539] 10.222.0.58 () {60 vars in 1322 bytes} [Wed Jan 19 16:05:09 2022] POST /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058/os-volume_attachments => generated 174 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:05:10.210443 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-a50530cf-d3f0-4307-8022-ea2d6e77b05c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:10.213092 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-a50530cf-d3f0-4307-8022-ea2d6e77b05c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:10.228384 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a50530cf-d3f0-4307-8022-ea2d6e77b05c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:10.229059 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a50530cf-d3f0-4307-8022-ea2d6e77b05c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:10.230193 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a50530cf-d3f0-4307-8022-ea2d6e77b05c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:10.230898 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a50530cf-d3f0-4307-8022-ea2d6e77b05c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:10.252910 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-de8ecec1-1547-4fb4-81fe-e3b1d7fba5c1 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:10.261725 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-de8ecec1-1547-4fb4-81fe-e3b1d7fba5c1 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1313 microversion: 2.1 time: 0.208244 Jan 19 16:05:10.262385 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 285/540] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:10 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:10.412566 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.objects.instance [None req-a50530cf-d3f0-4307-8022-ea2d6e77b05c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lazy-loading 'services' on Instance uuid ad149c5f-bf90-41d8-b480-18b9dafbd058 {{(pid=128875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:05:10.670323 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a1507b47-de7e-4a66-aa9f-1d2c5a2ad9c4 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:10.671013 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a1507b47-de7e-4a66-aa9f-1d2c5a2ad9c4 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:10.678331 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a1507b47-de7e-4a66-aa9f-1d2c5a2ad9c4 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:10.678773 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a1507b47-de7e-4a66-aa9f-1d2c5a2ad9c4 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:10.679602 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a1507b47-de7e-4a66-aa9f-1d2c5a2ad9c4 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:10.680078 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a1507b47-de7e-4a66-aa9f-1d2c5a2ad9c4 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:10.741010 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-a50530cf-d3f0-4307-8022-ea2d6e77b05c tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058/os-volume_attachments/fd6d9866-4086-4986-827a-8b11210b6546" status: 202 len: 0 microversion: 2.1 time: 0.537135 Jan 19 16:05:10.742144 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 256/541] 10.222.0.58 () {58 vars in 1415 bytes} [Wed Jan 19 16:05:10 2022] DELETE /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058/os-volume_attachments/fd6d9866-4086-4986-827a-8b11210b6546 => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:05:10.748026 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-b2f792c3-0c09-46a9-8774-72a19c7b7c14 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:10.757216 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-b2f792c3-0c09-46a9-8774-72a19c7b7c14 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:10.765611 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b2f792c3-0c09-46a9-8774-72a19c7b7c14 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:10.766092 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b2f792c3-0c09-46a9-8774-72a19c7b7c14 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:10.766913 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b2f792c3-0c09-46a9-8774-72a19c7b7c14 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:10.767400 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b2f792c3-0c09-46a9-8774-72a19c7b7c14 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:10.858268 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a1507b47-de7e-4a66-aa9f-1d2c5a2ad9c4 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:10.870106 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a1507b47-de7e-4a66-aa9f-1d2c5a2ad9c4 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1277 microversion: 2.1 time: 0.203189 Jan 19 16:05:10.883559 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 286/542] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:10 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:05:10.896487 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-41d108e6-ded9-44a3-884c-f9126ca60bed tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:10.910755 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-41d108e6-ded9-44a3-884c-f9126ca60bed tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:10.910755 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-41d108e6-ded9-44a3-884c-f9126ca60bed tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:10.910755 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-41d108e6-ded9-44a3-884c-f9126ca60bed tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:10.910755 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-41d108e6-ded9-44a3-884c-f9126ca60bed tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:10.911122 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-41d108e6-ded9-44a3-884c-f9126ca60bed tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:10.958224 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-41d108e6-ded9-44a3-884c-f9126ca60bed tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072759 Jan 19 16:05:10.958816 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 287/543] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:05:10 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:05:10.963904 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-1b4e954e-8fdf-426f-b992-5d5fc636a0e4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:10.965144 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-1b4e954e-8fdf-426f-b992-5d5fc636a0e4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:10.973818 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1b4e954e-8fdf-426f-b992-5d5fc636a0e4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:10.974276 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1b4e954e-8fdf-426f-b992-5d5fc636a0e4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:10.975252 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1b4e954e-8fdf-426f-b992-5d5fc636a0e4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:10.975595 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1b4e954e-8fdf-426f-b992-5d5fc636a0e4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:11.050293 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-b2f792c3-0c09-46a9-8774-72a19c7b7c14 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.306257 Jan 19 16:05:11.051094 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 257/544] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:10 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:05:11.061817 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-67d76cd9-f953-44f0-ae28-0fc1009321ce tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:11.062798 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-67d76cd9-f953-44f0-ae28-0fc1009321ce tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:11.072669 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-67d76cd9-f953-44f0-ae28-0fc1009321ce tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:11.073524 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-67d76cd9-f953-44f0-ae28-0fc1009321ce tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:11.074613 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-67d76cd9-f953-44f0-ae28-0fc1009321ce tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:11.075298 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-67d76cd9-f953-44f0-ae28-0fc1009321ce tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:11.079088 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-1b4e954e-8fdf-426f-b992-5d5fc636a0e4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.118603 Jan 19 16:05:11.079986 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 288/545] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:10 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:05:11.235185 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-67d76cd9-f953-44f0-ae28-0fc1009321ce tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:11.250256 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-67d76cd9-f953-44f0-ae28-0fc1009321ce tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1565 microversion: 2.1 time: 0.196874 Jan 19 16:05:11.250854 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 258/546] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:11 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1565 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:11.279316 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-02f7c584-a9e5-4179-87bb-1fb7c36f4c82 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:11.280012 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-02f7c584-a9e5-4179-87bb-1fb7c36f4c82 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:11.293487 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-02f7c584-a9e5-4179-87bb-1fb7c36f4c82 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:11.294194 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-02f7c584-a9e5-4179-87bb-1fb7c36f4c82 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:11.295664 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-02f7c584-a9e5-4179-87bb-1fb7c36f4c82 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:11.296542 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-02f7c584-a9e5-4179-87bb-1fb7c36f4c82 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:11.517250 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-02f7c584-a9e5-4179-87bb-1fb7c36f4c82 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:11.527946 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-02f7c584-a9e5-4179-87bb-1fb7c36f4c82 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1313 microversion: 2.1 time: 0.252751 Jan 19 16:05:11.528567 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 289/547] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:11 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:11.903354 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-51b94078-6155-4178-b404-e49600a24112 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:11.904580 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-51b94078-6155-4178-b404-e49600a24112 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:11.916337 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-51b94078-6155-4178-b404-e49600a24112 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:11.917217 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-51b94078-6155-4178-b404-e49600a24112 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:11.918446 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-51b94078-6155-4178-b404-e49600a24112 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:11.918954 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-51b94078-6155-4178-b404-e49600a24112 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:11.972328 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f4cea41a-a3ad-4e05-8184-110bde1168bc tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:11.973460 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f4cea41a-a3ad-4e05-8184-110bde1168bc tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:11.980495 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f4cea41a-a3ad-4e05-8184-110bde1168bc tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:11.980940 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f4cea41a-a3ad-4e05-8184-110bde1168bc tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:11.981724 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f4cea41a-a3ad-4e05-8184-110bde1168bc tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:11.982200 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f4cea41a-a3ad-4e05-8184-110bde1168bc tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:12.021328 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f4cea41a-a3ad-4e05-8184-110bde1168bc tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052727 Jan 19 16:05:12.030095 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 290/548] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:05:11 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:05:12.067727 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e61aa0d6-de57-409a-a885-7502d37cccef tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:12.069342 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-e61aa0d6-de57-409a-a885-7502d37cccef tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:12.080289 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e61aa0d6-de57-409a-a885-7502d37cccef tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:12.081102 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e61aa0d6-de57-409a-a885-7502d37cccef tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:12.082564 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e61aa0d6-de57-409a-a885-7502d37cccef tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:12.089522 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e61aa0d6-de57-409a-a885-7502d37cccef tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:12.092627 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-51b94078-6155-4178-b404-e49600a24112 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:12.101187 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-51b94078-6155-4178-b404-e49600a24112 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1265 microversion: 2.1 time: 0.204770 Jan 19 16:05:12.102067 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 259/549] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:11 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:12.106996 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-683d7f95-1e5d-415f-b397-e18f3c92a0f9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:12.108034 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-683d7f95-1e5d-415f-b397-e18f3c92a0f9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:12.115093 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-683d7f95-1e5d-415f-b397-e18f3c92a0f9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:12.115537 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-683d7f95-1e5d-415f-b397-e18f3c92a0f9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:12.116390 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-683d7f95-1e5d-415f-b397-e18f3c92a0f9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:12.116886 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-683d7f95-1e5d-415f-b397-e18f3c92a0f9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:12.212227 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e61aa0d6-de57-409a-a885-7502d37cccef tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.151982 Jan 19 16:05:12.212883 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 291/550] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:12 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:05:12.264587 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-683d7f95-1e5d-415f-b397-e18f3c92a0f9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.161000 Jan 19 16:05:12.265232 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 260/551] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:12 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:05:12.276515 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5f6b78af-86c4-4435-af5c-4e5b5cacffa4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:12.277211 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5f6b78af-86c4-4435-af5c-4e5b5cacffa4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:12.287986 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5f6b78af-86c4-4435-af5c-4e5b5cacffa4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:12.288431 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5f6b78af-86c4-4435-af5c-4e5b5cacffa4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:12.289216 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5f6b78af-86c4-4435-af5c-4e5b5cacffa4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:12.289645 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5f6b78af-86c4-4435-af5c-4e5b5cacffa4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:12.459328 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5f6b78af-86c4-4435-af5c-4e5b5cacffa4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:12.467558 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5f6b78af-86c4-4435-af5c-4e5b5cacffa4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1565 microversion: 2.1 time: 0.195298 Jan 19 16:05:12.468145 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 292/552] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:12 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1565 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:12.545519 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-0f147352-e4e9-4d90-8a5a-7d744b5de206 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:12.546213 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-0f147352-e4e9-4d90-8a5a-7d744b5de206 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:12.555301 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0f147352-e4e9-4d90-8a5a-7d744b5de206 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:12.557419 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0f147352-e4e9-4d90-8a5a-7d744b5de206 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:12.557419 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0f147352-e4e9-4d90-8a5a-7d744b5de206 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:12.557419 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0f147352-e4e9-4d90-8a5a-7d744b5de206 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:12.710415 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-0f147352-e4e9-4d90-8a5a-7d744b5de206 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:12.718578 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-0f147352-e4e9-4d90-8a5a-7d744b5de206 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1313 microversion: 2.1 time: 0.176953 Jan 19 16:05:12.719766 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 261/553] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:12 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:13.038565 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-2ef5c26e-3803-481a-bc77-aa769fcf4670 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:13.039585 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-2ef5c26e-3803-481a-bc77-aa769fcf4670 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:13.046321 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2ef5c26e-3803-481a-bc77-aa769fcf4670 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:13.046765 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2ef5c26e-3803-481a-bc77-aa769fcf4670 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:13.047628 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2ef5c26e-3803-481a-bc77-aa769fcf4670 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:13.048065 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2ef5c26e-3803-481a-bc77-aa769fcf4670 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:13.079889 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-2ef5c26e-3803-481a-bc77-aa769fcf4670 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045242 Jan 19 16:05:13.080573 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 293/554] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:05:13 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:05:13.120744 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-0a3191f1-c808-4636-b172-95e51d608267 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:13.121339 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-0a3191f1-c808-4636-b172-95e51d608267 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:13.128365 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0a3191f1-c808-4636-b172-95e51d608267 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:13.128829 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0a3191f1-c808-4636-b172-95e51d608267 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:13.129626 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0a3191f1-c808-4636-b172-95e51d608267 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:13.130051 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0a3191f1-c808-4636-b172-95e51d608267 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:13.228877 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5dd6b589-bf18-4d50-8af7-b8ac9015c867 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:13.233338 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5dd6b589-bf18-4d50-8af7-b8ac9015c867 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:13.241401 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5dd6b589-bf18-4d50-8af7-b8ac9015c867 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:13.242213 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5dd6b589-bf18-4d50-8af7-b8ac9015c867 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:13.243299 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5dd6b589-bf18-4d50-8af7-b8ac9015c867 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:13.243852 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5dd6b589-bf18-4d50-8af7-b8ac9015c867 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:13.316627 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-0a3191f1-c808-4636-b172-95e51d608267 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:13.331420 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-0a3191f1-c808-4636-b172-95e51d608267 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1265 microversion: 2.1 time: 0.214496 Jan 19 16:05:13.332025 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 262/555] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:13 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:05:13.336930 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d785415d-4577-4e37-8ffc-73ee041a4d39 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-754003508", "imageRef": "6d9c05bd-015a-44de-bd51-f744cb247e7a", "flavorRef": "452", "networks": [{"uuid": "d642b74e-4dc9-4613-8da6-c9feaf68b80d"}]}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:13.347999 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5dd6b589-bf18-4d50-8af7-b8ac9015c867 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.125920 Jan 19 16:05:13.349253 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 294/556] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:13 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:05:13.371128 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f5e2ae23-c72c-448c-8eb9-3e94251af635 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:13.373350 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f5e2ae23-c72c-448c-8eb9-3e94251af635 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:13.385313 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f5e2ae23-c72c-448c-8eb9-3e94251af635 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:13.385991 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f5e2ae23-c72c-448c-8eb9-3e94251af635 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:13.387647 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f5e2ae23-c72c-448c-8eb9-3e94251af635 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:13.388351 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f5e2ae23-c72c-448c-8eb9-3e94251af635 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:13.392120 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.network.neutron [None req-d785415d-4577-4e37-8ffc-73ee041a4d39 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] validate_networks() for [('d642b74e-4dc9-4613-8da6-c9feaf68b80d', None, None, None, None, None)] {{(pid=128875) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:05:13.481106 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f5e2ae23-c72c-448c-8eb9-3e94251af635 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.129909 Jan 19 16:05:13.481878 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 295/557] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:13 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:05:13.486948 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-270ce6fc-8897-4708-ab29-94877975bbc9 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:13.487793 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-270ce6fc-8897-4708-ab29-94877975bbc9 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:13.494863 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-270ce6fc-8897-4708-ab29-94877975bbc9 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:13.495421 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-270ce6fc-8897-4708-ab29-94877975bbc9 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:13.496344 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-270ce6fc-8897-4708-ab29-94877975bbc9 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:13.496859 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-270ce6fc-8897-4708-ab29-94877975bbc9 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:13.654495 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-270ce6fc-8897-4708-ab29-94877975bbc9 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:13.662964 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-270ce6fc-8897-4708-ab29-94877975bbc9 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1565 microversion: 2.1 time: 0.179831 Jan 19 16:05:13.663669 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 296/558] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:13 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1565 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:13.747498 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-612ca610-ed2e-4cff-8ecd-af8c6811d707 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:13.749090 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-612ca610-ed2e-4cff-8ecd-af8c6811d707 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:13.759834 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-612ca610-ed2e-4cff-8ecd-af8c6811d707 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:13.760477 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-612ca610-ed2e-4cff-8ecd-af8c6811d707 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:13.761940 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-612ca610-ed2e-4cff-8ecd-af8c6811d707 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:13.762836 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-612ca610-ed2e-4cff-8ecd-af8c6811d707 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:13.840478 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-d785415d-4577-4e37-8ffc-73ee041a4d39 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Flavor limits 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:05:13.841204 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-d785415d-4577-4e37-8ffc-73ee041a4d39 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Image limits 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:05:13.841735 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-d785415d-4577-4e37-8ffc-73ee041a4d39 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Flavor pref 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:05:13.842147 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-d785415d-4577-4e37-8ffc-73ee041a4d39 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Image pref 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:05:13.842597 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-d785415d-4577-4e37-8ffc-73ee041a4d39 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:05:13.854551 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d785415d-4577-4e37-8ffc-73ee041a4d39 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:13.855135 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d785415d-4577-4e37-8ffc-73ee041a4d39 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:13.856048 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d785415d-4577-4e37-8ffc-73ee041a4d39 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:13.856560 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d785415d-4577-4e37-8ffc-73ee041a4d39 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:13.876233 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-d785415d-4577-4e37-8ffc-73ee041a4d39 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Getting quotas for project a7e40e4efd974d37820bb6724978d22f. Resources: {'ram', 'cores', 'instances'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:05:13.880849 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-d785415d-4577-4e37-8ffc-73ee041a4d39 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Getting quotas for user 3f7ace876fa34fe688d055a4a5fb1fdb and project a7e40e4efd974d37820bb6724978d22f. Resources: {'ram', 'cores', 'instances'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:05:13.894168 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d785415d-4577-4e37-8ffc-73ee041a4d39 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Going to run 1 instances... {{(pid=128875) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:05:13.896601 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d785415d-4577-4e37-8ffc-73ee041a4d39 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6d9c05bd-015a-44de-bd51-f744cb247e7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:05:13.920362 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-612ca610-ed2e-4cff-8ecd-af8c6811d707 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:13.928564 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-612ca610-ed2e-4cff-8ecd-af8c6811d707 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1313 microversion: 2.1 time: 0.187326 Jan 19 16:05:13.929161 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 297/559] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:13 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:05:14.057786 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d785415d-4577-4e37-8ffc-73ee041a4d39 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.724704 Jan 19 16:05:14.058478 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 263/560] 10.222.0.58 () {60 vars in 1146 bytes} [Wed Jan 19 16:05:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:05:14.069725 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-98f8619d-682b-4269-bc61-3a548eb2e15e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:14.070353 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-98f8619d-682b-4269-bc61-3a548eb2e15e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:14.129815 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-98f8619d-682b-4269-bc61-3a548eb2e15e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:14.142760 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-98f8619d-682b-4269-bc61-3a548eb2e15e tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1217 microversion: 2.1 time: 0.077172 Jan 19 16:05:14.144147 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 298/561] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:14 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:14.351470 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-5d845ee8-ba8b-44c4-96d9-b35427e80d7e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:14.352019 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-5d845ee8-ba8b-44c4-96d9-b35427e80d7e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:14.358895 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5d845ee8-ba8b-44c4-96d9-b35427e80d7e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:14.359367 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5d845ee8-ba8b-44c4-96d9-b35427e80d7e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:14.360367 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5d845ee8-ba8b-44c4-96d9-b35427e80d7e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:14.360579 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-2bee8993-c39c-4c20-af3b-128ad00b34d2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:14.360799 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5d845ee8-ba8b-44c4-96d9-b35427e80d7e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:14.361508 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-2bee8993-c39c-4c20-af3b-128ad00b34d2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:14.369008 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2bee8993-c39c-4c20-af3b-128ad00b34d2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:14.369442 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2bee8993-c39c-4c20-af3b-128ad00b34d2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:14.370414 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2bee8993-c39c-4c20-af3b-128ad00b34d2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:14.371039 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2bee8993-c39c-4c20-af3b-128ad00b34d2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:14.473997 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-2bee8993-c39c-4c20-af3b-128ad00b34d2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.117071 Jan 19 16:05:14.474649 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 299/562] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:14 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:05:14.496527 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-efe1af7f-1002-4677-a4c2-3849e2ee04ba tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:14.497697 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-efe1af7f-1002-4677-a4c2-3849e2ee04ba tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:14.507001 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-efe1af7f-1002-4677-a4c2-3849e2ee04ba tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:14.508005 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-efe1af7f-1002-4677-a4c2-3849e2ee04ba tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:14.508979 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-efe1af7f-1002-4677-a4c2-3849e2ee04ba tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:14.516243 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-efe1af7f-1002-4677-a4c2-3849e2ee04ba tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:14.518119 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-5d845ee8-ba8b-44c4-96d9-b35427e80d7e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:14.535365 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-5d845ee8-ba8b-44c4-96d9-b35427e80d7e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1265 microversion: 2.1 time: 0.187719 Jan 19 16:05:14.535957 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 264/563] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:14 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:14.617890 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-efe1af7f-1002-4677-a4c2-3849e2ee04ba tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.127436 Jan 19 16:05:14.618546 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 300/564] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:14 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:05:14.682602 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-8152acc5-8767-4b8f-8a37-e80d1d1fadf8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:14.683347 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8152acc5-8767-4b8f-8a37-e80d1d1fadf8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:14.693383 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8152acc5-8767-4b8f-8a37-e80d1d1fadf8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:14.694405 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8152acc5-8767-4b8f-8a37-e80d1d1fadf8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:14.695364 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8152acc5-8767-4b8f-8a37-e80d1d1fadf8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:14.696063 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8152acc5-8767-4b8f-8a37-e80d1d1fadf8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:14.855826 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8152acc5-8767-4b8f-8a37-e80d1d1fadf8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:14.863614 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-8152acc5-8767-4b8f-8a37-e80d1d1fadf8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1565 microversion: 2.1 time: 0.185200 Jan 19 16:05:14.864120 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 265/565] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:14 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1565 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:05:14.946998 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-6289a6ac-fe11-4ae8-9a11-3a1d5eede63a tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:14.947749 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-6289a6ac-fe11-4ae8-9a11-3a1d5eede63a tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:14.956052 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6289a6ac-fe11-4ae8-9a11-3a1d5eede63a tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:14.956482 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6289a6ac-fe11-4ae8-9a11-3a1d5eede63a tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:14.957284 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6289a6ac-fe11-4ae8-9a11-3a1d5eede63a tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:14.958004 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6289a6ac-fe11-4ae8-9a11-3a1d5eede63a tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:15.094517 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-6289a6ac-fe11-4ae8-9a11-3a1d5eede63a tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:15.102317 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-6289a6ac-fe11-4ae8-9a11-3a1d5eede63a tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1313 microversion: 2.1 time: 0.159853 Jan 19 16:05:15.103077 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 301/566] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:14 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:15.170094 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-33ddeca7-300b-4f86-a7d2-f9e9a925a169 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:15.170679 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-33ddeca7-300b-4f86-a7d2-f9e9a925a169 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:15.178132 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-33ddeca7-300b-4f86-a7d2-f9e9a925a169 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:15.178572 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-33ddeca7-300b-4f86-a7d2-f9e9a925a169 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:15.179422 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-33ddeca7-300b-4f86-a7d2-f9e9a925a169 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:15.179858 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-33ddeca7-300b-4f86-a7d2-f9e9a925a169 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:15.256832 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-33ddeca7-300b-4f86-a7d2-f9e9a925a169 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:15.264458 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-33ddeca7-300b-4f86-a7d2-f9e9a925a169 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1221 microversion: 2.1 time: 0.098047 Jan 19 16:05:15.265184 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 266/567] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:15 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1221 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:15.492482 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-7eda6f0a-f875-40aa-ac4b-f3b31f1cc8c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:15.494468 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-7eda6f0a-f875-40aa-ac4b-f3b31f1cc8c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:15.506042 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7eda6f0a-f875-40aa-ac4b-f3b31f1cc8c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:15.506888 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7eda6f0a-f875-40aa-ac4b-f3b31f1cc8c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:15.508428 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7eda6f0a-f875-40aa-ac4b-f3b31f1cc8c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:15.509248 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7eda6f0a-f875-40aa-ac4b-f3b31f1cc8c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:15.554594 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-3bdade7b-bcc1-4413-bb22-19696348ce39 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:15.555880 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-3bdade7b-bcc1-4413-bb22-19696348ce39 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:15.563590 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3bdade7b-bcc1-4413-bb22-19696348ce39 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:15.564286 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3bdade7b-bcc1-4413-bb22-19696348ce39 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:15.565275 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3bdade7b-bcc1-4413-bb22-19696348ce39 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:15.565919 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3bdade7b-bcc1-4413-bb22-19696348ce39 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:15.630382 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-7eda6f0a-f875-40aa-ac4b-f3b31f1cc8c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.146324 Jan 19 16:05:15.631328 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 302/568] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:15 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:05:15.637304 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-9dc149e0-049b-46ad-aef3-e2db28f1e4c4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:15.638312 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-9dc149e0-049b-46ad-aef3-e2db28f1e4c4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:15.646293 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9dc149e0-049b-46ad-aef3-e2db28f1e4c4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:15.646742 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9dc149e0-049b-46ad-aef3-e2db28f1e4c4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:15.647579 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9dc149e0-049b-46ad-aef3-e2db28f1e4c4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:15.648010 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9dc149e0-049b-46ad-aef3-e2db28f1e4c4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:15.728802 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-9dc149e0-049b-46ad-aef3-e2db28f1e4c4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.095862 Jan 19 16:05:15.733257 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 303/569] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:15 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:05:15.776358 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-3bdade7b-bcc1-4413-bb22-19696348ce39 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:15.787682 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-3bdade7b-bcc1-4413-bb22-19696348ce39 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1265 microversion: 2.1 time: 0.238274 Jan 19 16:05:15.788395 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 267/570] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:15 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:15.881645 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a610cf4a-c971-4db2-8d2f-3c8aa8cf4f97 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:15.882460 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a610cf4a-c971-4db2-8d2f-3c8aa8cf4f97 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:15.890278 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a610cf4a-c971-4db2-8d2f-3c8aa8cf4f97 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:15.891258 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a610cf4a-c971-4db2-8d2f-3c8aa8cf4f97 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:15.892107 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a610cf4a-c971-4db2-8d2f-3c8aa8cf4f97 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:15.892535 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a610cf4a-c971-4db2-8d2f-3c8aa8cf4f97 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:16.051913 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a610cf4a-c971-4db2-8d2f-3c8aa8cf4f97 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:16.060075 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a610cf4a-c971-4db2-8d2f-3c8aa8cf4f97 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1565 microversion: 2.1 time: 0.182619 Jan 19 16:05:16.060659 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 304/571] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:15 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1565 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:16.119712 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-7602344e-9477-4cf1-8a43-089f540afc44 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:16.120320 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-7602344e-9477-4cf1-8a43-089f540afc44 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:16.126828 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7602344e-9477-4cf1-8a43-089f540afc44 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:16.132120 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7602344e-9477-4cf1-8a43-089f540afc44 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:16.132120 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7602344e-9477-4cf1-8a43-089f540afc44 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:16.132120 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7602344e-9477-4cf1-8a43-089f540afc44 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:16.279128 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-7602344e-9477-4cf1-8a43-089f540afc44 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:16.280554 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b1ead032-787e-4ecb-9f5f-33284d85bf71 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:16.281163 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b1ead032-787e-4ecb-9f5f-33284d85bf71 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:16.292702 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-7602344e-9477-4cf1-8a43-089f540afc44 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1313 microversion: 2.1 time: 0.170821 Jan 19 16:05:16.292702 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 268/572] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:16 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:16.292940 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b1ead032-787e-4ecb-9f5f-33284d85bf71 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:16.292940 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b1ead032-787e-4ecb-9f5f-33284d85bf71 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:16.292940 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b1ead032-787e-4ecb-9f5f-33284d85bf71 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:16.292940 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b1ead032-787e-4ecb-9f5f-33284d85bf71 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:16.354936 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-b1ead032-787e-4ecb-9f5f-33284d85bf71 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:16.366940 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b1ead032-787e-4ecb-9f5f-33284d85bf71 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1269 microversion: 2.1 time: 0.089977 Jan 19 16:05:16.367591 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 305/573] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:16 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1269 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:05:16.643031 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-8d1b7442-d4ad-4449-b592-e8d4eac5ea38 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:16.644634 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8d1b7442-d4ad-4449-b592-e8d4eac5ea38 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:16.651095 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8d1b7442-d4ad-4449-b592-e8d4eac5ea38 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:16.651988 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8d1b7442-d4ad-4449-b592-e8d4eac5ea38 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:16.653126 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8d1b7442-d4ad-4449-b592-e8d4eac5ea38 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:16.653593 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8d1b7442-d4ad-4449-b592-e8d4eac5ea38 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:16.740741 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f417c726-b793-419e-a7d5-3bb3c9ce525e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:16.741750 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f417c726-b793-419e-a7d5-3bb3c9ce525e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:16.748417 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f417c726-b793-419e-a7d5-3bb3c9ce525e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:16.749072 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f417c726-b793-419e-a7d5-3bb3c9ce525e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:16.749897 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f417c726-b793-419e-a7d5-3bb3c9ce525e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:16.750875 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f417c726-b793-419e-a7d5-3bb3c9ce525e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:16.852156 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-8d1b7442-d4ad-4449-b592-e8d4eac5ea38 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.212519 Jan 19 16:05:16.853011 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 269/574] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:16 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:05:16.858507 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-a676977e-5343-4afd-b97e-243c69aa74d5 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:16.859142 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-a676977e-5343-4afd-b97e-243c69aa74d5 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:16.866850 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a676977e-5343-4afd-b97e-243c69aa74d5 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:16.867245 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a676977e-5343-4afd-b97e-243c69aa74d5 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:16.868363 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a676977e-5343-4afd-b97e-243c69aa74d5 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:16.868499 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a676977e-5343-4afd-b97e-243c69aa74d5 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:16.874427 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f417c726-b793-419e-a7d5-3bb3c9ce525e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.137280 Jan 19 16:05:16.878536 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 306/575] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:16 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:05:17.086609 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-cd276c37-0c48-40e0-b5d5-35c94e91cb83 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:17.088001 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-cd276c37-0c48-40e0-b5d5-35c94e91cb83 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:17.097886 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cd276c37-0c48-40e0-b5d5-35c94e91cb83 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:17.098336 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cd276c37-0c48-40e0-b5d5-35c94e91cb83 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:17.099202 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cd276c37-0c48-40e0-b5d5-35c94e91cb83 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:17.099639 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cd276c37-0c48-40e0-b5d5-35c94e91cb83 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:17.137789 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-a676977e-5343-4afd-b97e-243c69aa74d5 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:17.150864 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-a676977e-5343-4afd-b97e-243c69aa74d5 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1265 microversion: 2.1 time: 0.295671 Jan 19 16:05:17.162423 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 270/576] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:16 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1265 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:17.261810 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-cd276c37-0c48-40e0-b5d5-35c94e91cb83 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:17.270572 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-cd276c37-0c48-40e0-b5d5-35c94e91cb83 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1565 microversion: 2.1 time: 0.196325 Jan 19 16:05:17.271175 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 307/577] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:17 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1565 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:05:17.304072 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-1e1810a7-9d2e-4b40-bdb4-f4e52fe1e055 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:17.304672 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-1e1810a7-9d2e-4b40-bdb4-f4e52fe1e055 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:17.310377 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1e1810a7-9d2e-4b40-bdb4-f4e52fe1e055 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:17.310814 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1e1810a7-9d2e-4b40-bdb4-f4e52fe1e055 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:17.311615 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1e1810a7-9d2e-4b40-bdb4-f4e52fe1e055 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:17.312036 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1e1810a7-9d2e-4b40-bdb4-f4e52fe1e055 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:17.388902 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-59eaa17c-cb87-4251-ab94-cb60a1e25711 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:17.389436 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-59eaa17c-cb87-4251-ab94-cb60a1e25711 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:17.395945 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-59eaa17c-cb87-4251-ab94-cb60a1e25711 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:17.396387 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-59eaa17c-cb87-4251-ab94-cb60a1e25711 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:17.397166 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-59eaa17c-cb87-4251-ab94-cb60a1e25711 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:17.397729 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-59eaa17c-cb87-4251-ab94-cb60a1e25711 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:17.463285 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-59eaa17c-cb87-4251-ab94-cb60a1e25711 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:17.463455 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-1e1810a7-9d2e-4b40-bdb4-f4e52fe1e055 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:17.471524 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-59eaa17c-cb87-4251-ab94-cb60a1e25711 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1275 microversion: 2.1 time: 0.086373 Jan 19 16:05:17.471718 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-1e1810a7-9d2e-4b40-bdb4-f4e52fe1e055 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1313 microversion: 2.1 time: 0.171272 Jan 19 16:05:17.480942 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 271/579] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:17 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:05:17.481123 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 308/579] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:17 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1275 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:17.865351 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f3acbe5b-e70d-400f-9b18-ad41fe6f90ff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:17.866347 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-f3acbe5b-e70d-400f-9b18-ad41fe6f90ff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:17.872813 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f3acbe5b-e70d-400f-9b18-ad41fe6f90ff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:17.873256 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f3acbe5b-e70d-400f-9b18-ad41fe6f90ff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:17.874054 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f3acbe5b-e70d-400f-9b18-ad41fe6f90ff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:17.874487 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f3acbe5b-e70d-400f-9b18-ad41fe6f90ff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:17.886384 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-45a3076e-4e4a-42be-bcae-c4a056c1e096 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:17.887336 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-45a3076e-4e4a-42be-bcae-c4a056c1e096 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:17.893984 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-45a3076e-4e4a-42be-bcae-c4a056c1e096 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:17.894429 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-45a3076e-4e4a-42be-bcae-c4a056c1e096 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:17.895256 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-45a3076e-4e4a-42be-bcae-c4a056c1e096 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:17.895761 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-45a3076e-4e4a-42be-bcae-c4a056c1e096 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:24.232026 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f3acbe5b-e70d-400f-9b18-ad41fe6f90ff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 6.370346 Jan 19 16:05:24.232816 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 272/580] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:17 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 6372 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:05:24.238359 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-959b303c-7468-4ed6-8746-eaf1d78e6ad2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:24.239200 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-959b303c-7468-4ed6-8746-eaf1d78e6ad2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:24.246270 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-45a3076e-4e4a-42be-bcae-c4a056c1e096 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 6.363534 Jan 19 16:05:24.250265 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-959b303c-7468-4ed6-8746-eaf1d78e6ad2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:24.250403 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 309/581] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:17 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 6366 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:05:24.250518 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-959b303c-7468-4ed6-8746-eaf1d78e6ad2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:24.252469 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-959b303c-7468-4ed6-8746-eaf1d78e6ad2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:24.252620 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f68f8e04-d452-4b5a-a83c-eef126fe5859 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:24.253046 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-959b303c-7468-4ed6-8746-eaf1d78e6ad2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:24.264707 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f68f8e04-d452-4b5a-a83c-eef126fe5859 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:24.279577 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f68f8e04-d452-4b5a-a83c-eef126fe5859 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:24.280577 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f68f8e04-d452-4b5a-a83c-eef126fe5859 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:24.282575 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f68f8e04-d452-4b5a-a83c-eef126fe5859 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:24.283289 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f68f8e04-d452-4b5a-a83c-eef126fe5859 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:24.438954 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f68f8e04-d452-4b5a-a83c-eef126fe5859 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:24.447171 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f68f8e04-d452-4b5a-a83c-eef126fe5859 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1565 microversion: 2.1 time: 0.198138 Jan 19 16:05:24.448042 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 310/582] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:24 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1565 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:24.450989 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-959b303c-7468-4ed6-8746-eaf1d78e6ad2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:24.457008 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-770036e2-900d-4d6b-839f-d1ef7fbdd981 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:24.457648 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-770036e2-900d-4d6b-839f-d1ef7fbdd981 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:24.462199 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-959b303c-7468-4ed6-8746-eaf1d78e6ad2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1265 microversion: 2.1 time: 0.227993 Jan 19 16:05:24.462870 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 273/583] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:24 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:24.464650 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-770036e2-900d-4d6b-839f-d1ef7fbdd981 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:24.465091 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-770036e2-900d-4d6b-839f-d1ef7fbdd981 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:24.465871 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-770036e2-900d-4d6b-839f-d1ef7fbdd981 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:24.466466 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-770036e2-900d-4d6b-839f-d1ef7fbdd981 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:24.467349 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ff62744f-90aa-4338-95c2-43f857176bed tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:24.467943 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-ff62744f-90aa-4338-95c2-43f857176bed tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:24.474505 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ff62744f-90aa-4338-95c2-43f857176bed tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:24.474956 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ff62744f-90aa-4338-95c2-43f857176bed tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:24.476030 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ff62744f-90aa-4338-95c2-43f857176bed tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:24.476493 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ff62744f-90aa-4338-95c2-43f857176bed tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:24.626951 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-770036e2-900d-4d6b-839f-d1ef7fbdd981 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:24.628195 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ff62744f-90aa-4338-95c2-43f857176bed tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:24.635468 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-770036e2-900d-4d6b-839f-d1ef7fbdd981 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1317 microversion: 2.1 time: 0.182076 Jan 19 16:05:24.635659 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-ff62744f-90aa-4338-95c2-43f857176bed tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1313 microversion: 2.1 time: 0.171768 Jan 19 16:05:24.649678 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 311/585] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:24 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:24.649928 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 274/585] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:24 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:24.650046 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-b130abdc-824a-41eb-9806-bb6cb9c10701 req-5f582889-c995-4432-967a-7657a66f0801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e48fec90-7f72-4519-b6cf-dfcdc0c8225f", "name": "network-vif-plugged", "status": "completed", "tag": "f7b41b1e-9a19-457c-8074-1c6e8e142c6e"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:24.650152 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-4432ddac-501f-45d6-b93a-50e63bc832e4 req-8e963972-34b0-46d9-8a9a-e19af75232fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6452b53-f8fd-4bcf-853a-b6cba80219d3", "tag": "5398f5fc-b5dc-409d-a1d1-0ea421ad4c6a"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:24.650256 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:05:24.650256 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:05:24.650427 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:05:24.650427 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:05:24.656702 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-b130abdc-824a-41eb-9806-bb6cb9c10701 req-5f582889-c995-4432-967a-7657a66f0801 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:24.657062 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-4432ddac-501f-45d6-b93a-50e63bc832e4 req-8e963972-34b0-46d9-8a9a-e19af75232fb service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:24.657249 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-b130abdc-824a-41eb-9806-bb6cb9c10701 req-5f582889-c995-4432-967a-7657a66f0801 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:24.657504 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-4432ddac-501f-45d6-b93a-50e63bc832e4 req-8e963972-34b0-46d9-8a9a-e19af75232fb service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:24.668973 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-b130abdc-824a-41eb-9806-bb6cb9c10701 req-5f582889-c995-4432-967a-7657a66f0801 service nova] Creating event network-vif-plugged:f7b41b1e-9a19-457c-8074-1c6e8e142c6e for instance e48fec90-7f72-4519-b6cf-dfcdc0c8225f on hv-cinder-82002 Jan 19 16:05:24.675476 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-4432ddac-501f-45d6-b93a-50e63bc832e4 req-8e963972-34b0-46d9-8a9a-e19af75232fb service nova] Creating event network-changed:5398f5fc-b5dc-409d-a1d1-0ea421ad4c6a for instance d6452b53-f8fd-4bcf-853a-b6cba80219d3 on hv-cinder-82002 Jan 19 16:05:24.675625 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-b130abdc-824a-41eb-9806-bb6cb9c10701 req-5f582889-c995-4432-967a-7657a66f0801 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036349 Jan 19 16:05:24.675722 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-4432ddac-501f-45d6-b93a-50e63bc832e4 req-8e963972-34b0-46d9-8a9a-e19af75232fb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036675 Jan 19 16:05:24.675835 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 312/586] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:05:24.675925 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 275/587] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:05:25.247353 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-56cd98bb-8d8a-4f58-baf1-34a5282424cf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:25.248388 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-56cd98bb-8d8a-4f58-baf1-34a5282424cf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:25.255414 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-56cd98bb-8d8a-4f58-baf1-34a5282424cf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:25.255955 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-56cd98bb-8d8a-4f58-baf1-34a5282424cf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:25.257121 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-56cd98bb-8d8a-4f58-baf1-34a5282424cf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:25.257622 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-56cd98bb-8d8a-4f58-baf1-34a5282424cf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:25.266426 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-97986496-e5c7-4e2a-b539-56b3a852ee48 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:25.268168 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-97986496-e5c7-4e2a-b539-56b3a852ee48 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:25.276322 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-97986496-e5c7-4e2a-b539-56b3a852ee48 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:25.276932 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-97986496-e5c7-4e2a-b539-56b3a852ee48 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:25.277798 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-97986496-e5c7-4e2a-b539-56b3a852ee48 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:25.278227 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-97986496-e5c7-4e2a-b539-56b3a852ee48 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:31.962186 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-56cd98bb-8d8a-4f58-baf1-34a5282424cf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 6.719792 Jan 19 16:05:31.963054 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 313/588] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:25 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 6722 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:05:31.968591 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a0b59284-ff47-49b1-9f2e-3f76b63fd949 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:31.972515 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a0b59284-ff47-49b1-9f2e-3f76b63fd949 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:31.977813 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a0b59284-ff47-49b1-9f2e-3f76b63fd949 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:31.978300 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a0b59284-ff47-49b1-9f2e-3f76b63fd949 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:31.979154 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a0b59284-ff47-49b1-9f2e-3f76b63fd949 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:31.979594 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a0b59284-ff47-49b1-9f2e-3f76b63fd949 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:32.164733 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a0b59284-ff47-49b1-9f2e-3f76b63fd949 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:32.173887 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a0b59284-ff47-49b1-9f2e-3f76b63fd949 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1565 microversion: 2.1 time: 0.209748 Jan 19 16:05:32.174864 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 314/589] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:31 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1565 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:32.179704 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-077d2eca-aac4-48eb-9454-18e49edc3ef7 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:32.180313 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-077d2eca-aac4-48eb-9454-18e49edc3ef7 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:32.188285 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-077d2eca-aac4-48eb-9454-18e49edc3ef7 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:32.188786 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-077d2eca-aac4-48eb-9454-18e49edc3ef7 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:32.190195 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-077d2eca-aac4-48eb-9454-18e49edc3ef7 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:32.190636 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-077d2eca-aac4-48eb-9454-18e49edc3ef7 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:32.340962 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-077d2eca-aac4-48eb-9454-18e49edc3ef7 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:32.354314 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-077d2eca-aac4-48eb-9454-18e49edc3ef7 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1265 microversion: 2.1 time: 0.178365 Jan 19 16:05:32.355570 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 315/590] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:32 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:32.366680 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-08b28332-66cf-455c-bc0a-2ccef5e597f4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:32.375555 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-08b28332-66cf-455c-bc0a-2ccef5e597f4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:32.379357 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-08b28332-66cf-455c-bc0a-2ccef5e597f4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:32.380176 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-08b28332-66cf-455c-bc0a-2ccef5e597f4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:32.381453 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-08b28332-66cf-455c-bc0a-2ccef5e597f4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:32.382242 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-08b28332-66cf-455c-bc0a-2ccef5e597f4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:32.569826 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-08b28332-66cf-455c-bc0a-2ccef5e597f4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:32.577818 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-08b28332-66cf-455c-bc0a-2ccef5e597f4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1317 microversion: 2.1 time: 0.220948 Jan 19 16:05:32.578415 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 316/591] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:32 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:32.582963 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ea500427-7484-4afb-bb2c-af5748cd90bf tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:32.583603 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ea500427-7484-4afb-bb2c-af5748cd90bf tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:32.590301 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ea500427-7484-4afb-bb2c-af5748cd90bf tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:32.590742 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ea500427-7484-4afb-bb2c-af5748cd90bf tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:32.591582 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ea500427-7484-4afb-bb2c-af5748cd90bf tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:32.592012 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ea500427-7484-4afb-bb2c-af5748cd90bf tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:32.746533 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ea500427-7484-4afb-bb2c-af5748cd90bf tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:32.754860 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ea500427-7484-4afb-bb2c-af5748cd90bf tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1313 microversion: 2.1 time: 0.175333 Jan 19 16:05:32.755517 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 317/592] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:32 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:32.964571 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-97986496-e5c7-4e2a-b539-56b3a852ee48 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 7.706836 Jan 19 16:05:32.965499 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 276/593] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:25 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 7709 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:05:32.980915 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-da658cf5-ec00-4b06-b716-b3ab0a12e86d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:32.982753 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-da658cf5-ec00-4b06-b716-b3ab0a12e86d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:32.992522 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-da658cf5-ec00-4b06-b716-b3ab0a12e86d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:32.993098 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-da658cf5-ec00-4b06-b716-b3ab0a12e86d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:32.994264 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-da658cf5-ec00-4b06-b716-b3ab0a12e86d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:32.994908 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-da658cf5-ec00-4b06-b716-b3ab0a12e86d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:33.192140 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-df29ad47-dbb8-4f58-911d-1f49702cee61 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:33.192843 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-df29ad47-dbb8-4f58-911d-1f49702cee61 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:33.201182 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-df29ad47-dbb8-4f58-911d-1f49702cee61 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:33.201631 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-df29ad47-dbb8-4f58-911d-1f49702cee61 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:33.202443 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-df29ad47-dbb8-4f58-911d-1f49702cee61 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:33.202882 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-df29ad47-dbb8-4f58-911d-1f49702cee61 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:33.276844 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-da658cf5-ec00-4b06-b716-b3ab0a12e86d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.302279 Jan 19 16:05:33.277877 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 318/594] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:32 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:05:33.357600 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-df29ad47-dbb8-4f58-911d-1f49702cee61 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:33.366268 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-df29ad47-dbb8-4f58-911d-1f49702cee61 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1565 microversion: 2.1 time: 0.178209 Jan 19 16:05:33.367055 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 277/595] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:33 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:05:33.383011 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-559a0134-7107-444c-bf63-f8316f00a0bb tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:33.383887 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-559a0134-7107-444c-bf63-f8316f00a0bb tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:33.392115 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-559a0134-7107-444c-bf63-f8316f00a0bb tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:33.393083 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-559a0134-7107-444c-bf63-f8316f00a0bb tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:33.393904 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-559a0134-7107-444c-bf63-f8316f00a0bb tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:33.394335 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-559a0134-7107-444c-bf63-f8316f00a0bb tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:33.568587 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-559a0134-7107-444c-bf63-f8316f00a0bb tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:33.577147 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-559a0134-7107-444c-bf63-f8316f00a0bb tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1265 microversion: 2.1 time: 0.199081 Jan 19 16:05:33.577918 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 319/596] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:33 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:33.594359 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-cfc0fe66-84c0-4a1b-8982-56d24a0b5ece tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:33.594998 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-cfc0fe66-84c0-4a1b-8982-56d24a0b5ece tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:33.602111 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cfc0fe66-84c0-4a1b-8982-56d24a0b5ece tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:33.602561 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cfc0fe66-84c0-4a1b-8982-56d24a0b5ece tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:33.604143 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cfc0fe66-84c0-4a1b-8982-56d24a0b5ece tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:33.604579 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cfc0fe66-84c0-4a1b-8982-56d24a0b5ece tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:33.769674 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-cfc0fe66-84c0-4a1b-8982-56d24a0b5ece tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:33.775413 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-782dfcea-e461-44df-8a65-fe361bd2795c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:33.776027 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-782dfcea-e461-44df-8a65-fe361bd2795c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:33.779857 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-cfc0fe66-84c0-4a1b-8982-56d24a0b5ece tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1317 microversion: 2.1 time: 0.189194 Jan 19 16:05:33.780663 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 278/597] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:33 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:33.783578 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-782dfcea-e461-44df-8a65-fe361bd2795c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:33.784031 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-782dfcea-e461-44df-8a65-fe361bd2795c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:33.784848 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-782dfcea-e461-44df-8a65-fe361bd2795c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:33.785280 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-782dfcea-e461-44df-8a65-fe361bd2795c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:33.961294 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-782dfcea-e461-44df-8a65-fe361bd2795c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:33.970103 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-782dfcea-e461-44df-8a65-fe361bd2795c tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1313 microversion: 2.1 time: 0.198365 Jan 19 16:05:33.970722 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 320/598] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:33 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:05:33.981398 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f2c01492-ddd7-4edf-8879-8912082c87fc tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:33.983187 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-f2c01492-ddd7-4edf-8879-8912082c87fc tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:33.995246 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f2c01492-ddd7-4edf-8879-8912082c87fc tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:34.005992 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f2c01492-ddd7-4edf-8879-8912082c87fc tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:34.005992 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f2c01492-ddd7-4edf-8879-8912082c87fc tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:34.005992 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f2c01492-ddd7-4edf-8879-8912082c87fc tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:34.260999 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f2c01492-ddd7-4edf-8879-8912082c87fc tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.286177 Jan 19 16:05:34.262069 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 279/599] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:33 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:05:34.290469 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e2bad7b0-2cd6-4dda-adbe-af5967eba4a3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:34.291627 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-e2bad7b0-2cd6-4dda-adbe-af5967eba4a3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:34.299844 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e2bad7b0-2cd6-4dda-adbe-af5967eba4a3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:34.300427 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e2bad7b0-2cd6-4dda-adbe-af5967eba4a3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:34.301425 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e2bad7b0-2cd6-4dda-adbe-af5967eba4a3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:34.302260 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e2bad7b0-2cd6-4dda-adbe-af5967eba4a3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:34.390922 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-9baa8717-e38a-40fa-bcfd-3cef43828787 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:34.391785 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-9baa8717-e38a-40fa-bcfd-3cef43828787 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:34.399662 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9baa8717-e38a-40fa-bcfd-3cef43828787 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:34.400256 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9baa8717-e38a-40fa-bcfd-3cef43828787 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:34.400949 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9baa8717-e38a-40fa-bcfd-3cef43828787 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:34.401382 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9baa8717-e38a-40fa-bcfd-3cef43828787 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:34.424596 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e2bad7b0-2cd6-4dda-adbe-af5967eba4a3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.137251 Jan 19 16:05:34.425884 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 321/600] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:34 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:05:34.596655 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ceb483fe-46b1-496b-bef2-2462f18604ae tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:34.597532 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ceb483fe-46b1-496b-bef2-2462f18604ae tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:34.609965 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ceb483fe-46b1-496b-bef2-2462f18604ae tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:34.609965 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ceb483fe-46b1-496b-bef2-2462f18604ae tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:34.609965 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ceb483fe-46b1-496b-bef2-2462f18604ae tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:34.609965 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ceb483fe-46b1-496b-bef2-2462f18604ae tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:34.689322 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-9baa8717-e38a-40fa-bcfd-3cef43828787 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:34.702009 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-9baa8717-e38a-40fa-bcfd-3cef43828787 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1565 microversion: 2.1 time: 0.315118 Jan 19 16:05:34.704176 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 280/601] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:34 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1565 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:05:34.796205 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ceb483fe-46b1-496b-bef2-2462f18604ae tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:34.802924 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-bfd89072-860b-4e33-8cc6-92255cbe68bd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:34.803835 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-bfd89072-860b-4e33-8cc6-92255cbe68bd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:34.806378 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ceb483fe-46b1-496b-bef2-2462f18604ae tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1265 microversion: 2.1 time: 0.215576 Jan 19 16:05:34.807221 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 322/602] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:34 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:05:34.817530 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bfd89072-860b-4e33-8cc6-92255cbe68bd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:34.818704 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bfd89072-860b-4e33-8cc6-92255cbe68bd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:34.823405 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bfd89072-860b-4e33-8cc6-92255cbe68bd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:34.824663 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bfd89072-860b-4e33-8cc6-92255cbe68bd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:34.987788 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-375aadc9-63c7-474e-b694-3b9cf49260ea tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:34.988516 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-375aadc9-63c7-474e-b694-3b9cf49260ea tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:34.995435 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-375aadc9-63c7-474e-b694-3b9cf49260ea tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:34.995963 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-375aadc9-63c7-474e-b694-3b9cf49260ea tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:34.996838 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-375aadc9-63c7-474e-b694-3b9cf49260ea tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:34.997359 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-375aadc9-63c7-474e-b694-3b9cf49260ea tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:35.157146 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-bfd89072-860b-4e33-8cc6-92255cbe68bd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:35.164799 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-375aadc9-63c7-474e-b694-3b9cf49260ea tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:35.167430 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-bfd89072-860b-4e33-8cc6-92255cbe68bd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1317 microversion: 2.1 time: 0.371731 Jan 19 16:05:35.174528 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-375aadc9-63c7-474e-b694-3b9cf49260ea tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1313 microversion: 2.1 time: 0.190290 Jan 19 16:05:35.176354 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 323/604] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:34 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:05:35.177803 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 281/604] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:34 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:05:35.275648 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-95649d98-7175-4ec3-a736-8880be27860f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:35.276615 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-95649d98-7175-4ec3-a736-8880be27860f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:35.284022 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-95649d98-7175-4ec3-a736-8880be27860f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:35.284473 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-95649d98-7175-4ec3-a736-8880be27860f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:35.285274 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-95649d98-7175-4ec3-a736-8880be27860f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:35.285710 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-95649d98-7175-4ec3-a736-8880be27860f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:35.362810 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-95649d98-7175-4ec3-a736-8880be27860f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 28590 microversion: 2.1 time: 0.091058 Jan 19 16:05:35.363935 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 324/605] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:35 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 28590 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:05:35.438385 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-5ffdb8da-321e-4cdb-87e0-9f5db15b9588 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:35.439375 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-5ffdb8da-321e-4cdb-87e0-9f5db15b9588 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:35.446017 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5ffdb8da-321e-4cdb-87e0-9f5db15b9588 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:35.446490 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5ffdb8da-321e-4cdb-87e0-9f5db15b9588 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:35.447342 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5ffdb8da-321e-4cdb-87e0-9f5db15b9588 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:35.447787 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5ffdb8da-321e-4cdb-87e0-9f5db15b9588 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:35.567770 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-5ffdb8da-321e-4cdb-87e0-9f5db15b9588 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 28663 microversion: 2.20 time: 0.132857 Jan 19 16:05:35.568882 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 282/606] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:35 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 28663 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:05:35.716239 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-297aab2e-d134-4d56-8b3b-9c5932f8db6a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f03cd52-56fc-49ce-975d-07f77fd216f5", "device": "/dev/sdb"}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:35.722002 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-297aab2e-d134-4d56-8b3b-9c5932f8db6a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:35.724085 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-13e172f6-89a7-4fef-86b9-0da8df474dad tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:35.724790 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-13e172f6-89a7-4fef-86b9-0da8df474dad tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:35.729276 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-297aab2e-d134-4d56-8b3b-9c5932f8db6a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:35.729956 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-297aab2e-d134-4d56-8b3b-9c5932f8db6a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:35.731410 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-297aab2e-d134-4d56-8b3b-9c5932f8db6a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:35.731883 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-13e172f6-89a7-4fef-86b9-0da8df474dad tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:35.732218 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-297aab2e-d134-4d56-8b3b-9c5932f8db6a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:35.732326 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-13e172f6-89a7-4fef-86b9-0da8df474dad tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:35.733107 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-13e172f6-89a7-4fef-86b9-0da8df474dad tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:35.733534 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-13e172f6-89a7-4fef-86b9-0da8df474dad tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:35.897549 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-13e172f6-89a7-4fef-86b9-0da8df474dad tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:35.905936 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-13e172f6-89a7-4fef-86b9-0da8df474dad tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1565 microversion: 2.1 time: 0.186883 Jan 19 16:05:35.906519 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 283/607] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:35 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1565 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:35.911474 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-8c191c53-ffd7-414f-808d-7517814e77c8 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:35.912067 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8c191c53-ffd7-414f-808d-7517814e77c8 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:35.918099 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8c191c53-ffd7-414f-808d-7517814e77c8 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:35.918536 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8c191c53-ffd7-414f-808d-7517814e77c8 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:35.919343 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8c191c53-ffd7-414f-808d-7517814e77c8 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:35.919766 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8c191c53-ffd7-414f-808d-7517814e77c8 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:36.085910 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8c191c53-ffd7-414f-808d-7517814e77c8 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:36.094140 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-8c191c53-ffd7-414f-808d-7517814e77c8 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1265 microversion: 2.1 time: 0.186544 Jan 19 16:05:36.094733 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 284/608] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:35 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:36.187993 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-84d0d90e-b23e-4275-8622-cc1a7c374ef5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:36.187993 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-84d0d90e-b23e-4275-8622-cc1a7c374ef5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:36.193458 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-84d0d90e-b23e-4275-8622-cc1a7c374ef5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:36.193964 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-84d0d90e-b23e-4275-8622-cc1a7c374ef5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:36.194820 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-84d0d90e-b23e-4275-8622-cc1a7c374ef5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:36.195264 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-84d0d90e-b23e-4275-8622-cc1a7c374ef5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:36.373223 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-84d0d90e-b23e-4275-8622-cc1a7c374ef5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:36.380865 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-84d0d90e-b23e-4275-8622-cc1a7c374ef5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1317 microversion: 2.1 time: 0.198152 Jan 19 16:05:36.381446 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 285/609] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:36 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:36.386040 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-fc8ac374-4cee-4ce9-a773-32d9c68bd316 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:36.386642 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-fc8ac374-4cee-4ce9-a773-32d9c68bd316 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:36.396390 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fc8ac374-4cee-4ce9-a773-32d9c68bd316 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:36.399629 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fc8ac374-4cee-4ce9-a773-32d9c68bd316 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:36.399629 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fc8ac374-4cee-4ce9-a773-32d9c68bd316 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:36.399629 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fc8ac374-4cee-4ce9-a773-32d9c68bd316 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:36.579772 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-fc8ac374-4cee-4ce9-a773-32d9c68bd316 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:36.595994 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-fc8ac374-4cee-4ce9-a773-32d9c68bd316 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1496 microversion: 2.1 time: 0.213118 Jan 19 16:05:36.598129 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 286/610] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:36 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1496 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:36.604779 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-a53f5a03-5730-4df5-82d5-e2d6c47342ec tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:36.605810 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-a53f5a03-5730-4df5-82d5-e2d6c47342ec tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:36.613280 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a53f5a03-5730-4df5-82d5-e2d6c47342ec tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:36.613763 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a53f5a03-5730-4df5-82d5-e2d6c47342ec tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:36.614526 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a53f5a03-5730-4df5-82d5-e2d6c47342ec tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:36.614958 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a53f5a03-5730-4df5-82d5-e2d6c47342ec tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:36.631475 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-297aab2e-d134-4d56-8b3b-9c5932f8db6a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "POST /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.918756 Jan 19 16:05:36.640847 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 325/611] 10.222.0.58 () {60 vars in 1322 bytes} [Wed Jan 19 16:05:35 2022] POST /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9/os-volume_attachments => generated 194 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:05:36.653808 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-2ac55ce0-5435-4618-8bed-1618a05814d6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:36.656250 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-2ac55ce0-5435-4618-8bed-1618a05814d6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:36.670955 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2ac55ce0-5435-4618-8bed-1618a05814d6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:36.672104 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2ac55ce0-5435-4618-8bed-1618a05814d6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:36.673778 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2ac55ce0-5435-4618-8bed-1618a05814d6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:36.674746 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2ac55ce0-5435-4618-8bed-1618a05814d6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:36.806143 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-a53f5a03-5730-4df5-82d5-e2d6c47342ec tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 29311 microversion: 2.1 time: 0.206067 Jan 19 16:05:36.807006 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 287/612] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:36 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 29311 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:05:36.857345 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-2ac55ce0-5435-4618-8bed-1618a05814d6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 29374 microversion: 2.20 time: 0.213252 Jan 19 16:05:36.859141 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 326/613] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:36 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 29374 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:05:36.933813 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e4c2244a-eb50-4fb1-b136-273b8faa2c02 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:36.934497 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-e4c2244a-eb50-4fb1-b136-273b8faa2c02 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:36.942563 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e4c2244a-eb50-4fb1-b136-273b8faa2c02 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:36.945443 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e4c2244a-eb50-4fb1-b136-273b8faa2c02 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:36.945443 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e4c2244a-eb50-4fb1-b136-273b8faa2c02 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:36.945443 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e4c2244a-eb50-4fb1-b136-273b8faa2c02 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:37.096315 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e4c2244a-eb50-4fb1-b136-273b8faa2c02 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:37.105001 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e4c2244a-eb50-4fb1-b136-273b8faa2c02 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1565 microversion: 2.1 time: 0.175256 Jan 19 16:05:37.115168 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 288/614] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:36 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:37.120043 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-761c559d-57c3-4b34-9b5a-ef67f3ddfa8b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:37.121075 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-761c559d-57c3-4b34-9b5a-ef67f3ddfa8b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:37.129590 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-761c559d-57c3-4b34-9b5a-ef67f3ddfa8b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:37.130038 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-761c559d-57c3-4b34-9b5a-ef67f3ddfa8b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:37.130830 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-761c559d-57c3-4b34-9b5a-ef67f3ddfa8b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:37.131293 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-761c559d-57c3-4b34-9b5a-ef67f3ddfa8b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:37.305252 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-761c559d-57c3-4b34-9b5a-ef67f3ddfa8b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:37.318890 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-761c559d-57c3-4b34-9b5a-ef67f3ddfa8b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1265 microversion: 2.1 time: 0.209807 Jan 19 16:05:37.328420 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 327/615] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:37 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:37.397955 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6041c1d2-9891-406b-8b03-793be49482ad tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:37.398811 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-6041c1d2-9891-406b-8b03-793be49482ad tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:37.405620 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6041c1d2-9891-406b-8b03-793be49482ad tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:37.406056 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6041c1d2-9891-406b-8b03-793be49482ad tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:37.406897 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6041c1d2-9891-406b-8b03-793be49482ad tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:37.407418 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6041c1d2-9891-406b-8b03-793be49482ad tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:37.619874 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6041c1d2-9891-406b-8b03-793be49482ad tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:37.627743 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6041c1d2-9891-406b-8b03-793be49482ad tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1317 microversion: 2.1 time: 0.233662 Jan 19 16:05:37.628379 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 289/616] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:37 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:05:37.825678 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-06b235db-4a09-4962-b4a7-975175aeb4f2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:37.825678 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-06b235db-4a09-4962-b4a7-975175aeb4f2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:37.832516 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-06b235db-4a09-4962-b4a7-975175aeb4f2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:37.833287 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-06b235db-4a09-4962-b4a7-975175aeb4f2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:37.834797 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-06b235db-4a09-4962-b4a7-975175aeb4f2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:37.835600 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-06b235db-4a09-4962-b4a7-975175aeb4f2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:37.872406 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-65cff801-5cec-4711-9443-b559f08a80de tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:37.873059 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-65cff801-5cec-4711-9443-b559f08a80de tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:37.879775 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-65cff801-5cec-4711-9443-b559f08a80de tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:37.880214 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-65cff801-5cec-4711-9443-b559f08a80de tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:37.881108 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-65cff801-5cec-4711-9443-b559f08a80de tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:37.881451 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-65cff801-5cec-4711-9443-b559f08a80de tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:37.989629 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-65cff801-5cec-4711-9443-b559f08a80de tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 30338 microversion: 2.20 time: 0.122682 Jan 19 16:05:37.990296 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 290/617] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:37 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 30338 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:05:37.995298 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-8f42c784-67f0-41b5-bd96-55b036d148ec tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:37.995868 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8f42c784-67f0-41b5-bd96-55b036d148ec tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:38.003480 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8f42c784-67f0-41b5-bd96-55b036d148ec tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:38.003915 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8f42c784-67f0-41b5-bd96-55b036d148ec tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:38.004703 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8f42c784-67f0-41b5-bd96-55b036d148ec tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:38.005132 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8f42c784-67f0-41b5-bd96-55b036d148ec tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:38.022742 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-06b235db-4a09-4962-b4a7-975175aeb4f2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 30580 microversion: 2.1 time: 0.207876 Jan 19 16:05:38.024002 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 328/618] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:37 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 30580 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:05:38.032182 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8f42c784-67f0-41b5-bd96-55b036d148ec tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Going to try to terminate instance {{(pid=128875) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:05:38.131258 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-03decfe2-f310-4393-9f4a-36f408225ed7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:38.132504 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-03decfe2-f310-4393-9f4a-36f408225ed7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:38.147201 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-03decfe2-f310-4393-9f4a-36f408225ed7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:38.148006 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-03decfe2-f310-4393-9f4a-36f408225ed7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:38.149526 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-03decfe2-f310-4393-9f4a-36f408225ed7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:38.150326 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-03decfe2-f310-4393-9f4a-36f408225ed7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:38.379969 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-03decfe2-f310-4393-9f4a-36f408225ed7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:38.391077 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-03decfe2-f310-4393-9f4a-36f408225ed7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1565 microversion: 2.1 time: 0.268973 Jan 19 16:05:38.395034 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 329/619] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:38 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1565 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:38.396717 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e4ea2cbc-88f6-4bd7-a659-e17a605f99d1 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:38.397914 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-e4ea2cbc-88f6-4bd7-a659-e17a605f99d1 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:38.404694 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e4ea2cbc-88f6-4bd7-a659-e17a605f99d1 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:38.405084 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e4ea2cbc-88f6-4bd7-a659-e17a605f99d1 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:38.405997 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e4ea2cbc-88f6-4bd7-a659-e17a605f99d1 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:38.406438 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e4ea2cbc-88f6-4bd7-a659-e17a605f99d1 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:38.460370 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-8f42c784-67f0-41b5-bd96-55b036d148ec tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 204 len: 0 microversion: 2.1 time: 0.468650 Jan 19 16:05:38.461471 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 291/620] 10.222.0.58 () {58 vars in 1238 bytes} [Wed Jan 19 16:05:37 2022] DELETE /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:05:38.472315 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-87323604-d14c-4421-aed6-21c6c4396caa tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:38.473074 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-87323604-d14c-4421-aed6-21c6c4396caa tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:38.480569 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-87323604-d14c-4421-aed6-21c6c4396caa tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:38.481018 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-87323604-d14c-4421-aed6-21c6c4396caa tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:38.481833 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-87323604-d14c-4421-aed6-21c6c4396caa tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:38.482270 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-87323604-d14c-4421-aed6-21c6c4396caa tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:38.586119 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e4ea2cbc-88f6-4bd7-a659-e17a605f99d1 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:38.597117 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e4ea2cbc-88f6-4bd7-a659-e17a605f99d1 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1265 microversion: 2.1 time: 0.203846 Jan 19 16:05:38.611722 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 330/621] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:38 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:38.649066 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3c478f3f-aea5-4bcf-b96a-b907988e48a7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:38.650096 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3c478f3f-aea5-4bcf-b96a-b907988e48a7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:38.661544 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3c478f3f-aea5-4bcf-b96a-b907988e48a7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:38.662209 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3c478f3f-aea5-4bcf-b96a-b907988e48a7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:38.663383 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3c478f3f-aea5-4bcf-b96a-b907988e48a7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:38.664097 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3c478f3f-aea5-4bcf-b96a-b907988e48a7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:38.691417 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-87323604-d14c-4421-aed6-21c6c4396caa tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:38.704444 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-87323604-d14c-4421-aed6-21c6c4396caa tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1502 microversion: 2.1 time: 0.236529 Jan 19 16:05:38.705497 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 292/622] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:38 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1502 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:05:38.840880 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-3c478f3f-aea5-4bcf-b96a-b907988e48a7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:38.849340 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3c478f3f-aea5-4bcf-b96a-b907988e48a7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1317 microversion: 2.1 time: 0.208077 Jan 19 16:05:38.849935 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 331/623] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:38 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:05:39.002825 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-62ef94c9-0465-457f-b91e-6d41c3ed24fc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:39.003952 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-62ef94c9-0465-457f-b91e-6d41c3ed24fc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:39.010598 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-62ef94c9-0465-457f-b91e-6d41c3ed24fc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:39.011094 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-62ef94c9-0465-457f-b91e-6d41c3ed24fc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:39.011868 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-62ef94c9-0465-457f-b91e-6d41c3ed24fc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:39.012300 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-62ef94c9-0465-457f-b91e-6d41c3ed24fc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:39.037000 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a3b02717-91a8-4c0b-bb54-2f66b84007cb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:39.038774 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a3b02717-91a8-4c0b-bb54-2f66b84007cb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:39.046097 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a3b02717-91a8-4c0b-bb54-2f66b84007cb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:39.046551 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a3b02717-91a8-4c0b-bb54-2f66b84007cb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:39.047404 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a3b02717-91a8-4c0b-bb54-2f66b84007cb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:39.047840 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a3b02717-91a8-4c0b-bb54-2f66b84007cb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:39.757686 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-62ef94c9-0465-457f-b91e-6d41c3ed24fc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 31925 microversion: 2.20 time: 0.758523 Jan 19 16:05:39.758720 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 293/624] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:38 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 31925 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:05:39.766134 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c4e35914-7288-4e0a-9411-769698c6c730 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:39.766899 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c4e35914-7288-4e0a-9411-769698c6c730 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:39.777617 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a3b02717-91a8-4c0b-bb54-2f66b84007cb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 31990 microversion: 2.1 time: 0.745700 Jan 19 16:05:39.777915 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c4e35914-7288-4e0a-9411-769698c6c730 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:39.778358 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c4e35914-7288-4e0a-9411-769698c6c730 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:39.782591 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 332/625] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:39 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 31990 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:05:39.783402 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c4e35914-7288-4e0a-9411-769698c6c730 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:39.783402 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c4e35914-7288-4e0a-9411-769698c6c730 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:39.789367 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5453eddb-0d64-40d9-bbc7-3137b56a7f6e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:39.797441 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5453eddb-0d64-40d9-bbc7-3137b56a7f6e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:39.803398 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5453eddb-0d64-40d9-bbc7-3137b56a7f6e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:39.804148 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5453eddb-0d64-40d9-bbc7-3137b56a7f6e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:39.805497 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5453eddb-0d64-40d9-bbc7-3137b56a7f6e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:39.806249 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5453eddb-0d64-40d9-bbc7-3137b56a7f6e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:39.980041 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5453eddb-0d64-40d9-bbc7-3137b56a7f6e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:39.987979 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5453eddb-0d64-40d9-bbc7-3137b56a7f6e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1265 microversion: 2.1 time: 0.207410 Jan 19 16:05:39.988233 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c4e35914-7288-4e0a-9411-769698c6c730 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:39.988766 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 333/626] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:39 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:39.993649 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e34f98ba-d6ef-4d36-b960-9f8f8d47f61e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:39.994266 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-e34f98ba-d6ef-4d36-b960-9f8f8d47f61e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:40.000260 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c4e35914-7288-4e0a-9411-769698c6c730 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1545 microversion: 2.1 time: 0.239669 Jan 19 16:05:40.001056 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e34f98ba-d6ef-4d36-b960-9f8f8d47f61e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:40.001225 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 294/627] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:39 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1545 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:40.001929 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e34f98ba-d6ef-4d36-b960-9f8f8d47f61e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:40.002837 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e34f98ba-d6ef-4d36-b960-9f8f8d47f61e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:40.003556 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e34f98ba-d6ef-4d36-b960-9f8f8d47f61e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:40.011704 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6abb5127-4dd7-45ec-85ef-e4852be1c313 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:40.012153 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-6abb5127-4dd7-45ec-85ef-e4852be1c313 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:40.021449 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6abb5127-4dd7-45ec-85ef-e4852be1c313 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:40.022053 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6abb5127-4dd7-45ec-85ef-e4852be1c313 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:40.022986 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6abb5127-4dd7-45ec-85ef-e4852be1c313 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:40.023567 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6abb5127-4dd7-45ec-85ef-e4852be1c313 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:40.178435 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e34f98ba-d6ef-4d36-b960-9f8f8d47f61e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:40.187888 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e34f98ba-d6ef-4d36-b960-9f8f8d47f61e tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1502 microversion: 2.1 time: 0.198006 Jan 19 16:05:40.188550 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 334/628] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:39 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1502 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:40.194087 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d6175f58-e8fa-44d4-bf89-5abdeb734e01 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:40.195004 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-d6175f58-e8fa-44d4-bf89-5abdeb734e01 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:40.199236 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6abb5127-4dd7-45ec-85ef-e4852be1c313 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:40.202540 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d6175f58-e8fa-44d4-bf89-5abdeb734e01 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:40.202998 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d6175f58-e8fa-44d4-bf89-5abdeb734e01 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:40.203819 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d6175f58-e8fa-44d4-bf89-5abdeb734e01 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:40.204252 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d6175f58-e8fa-44d4-bf89-5abdeb734e01 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:40.211541 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6abb5127-4dd7-45ec-85ef-e4852be1c313 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1317 microversion: 2.1 time: 0.208770 Jan 19 16:05:40.214111 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 295/629] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:40 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:40.303224 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.wsgi [None req-d6175f58-e8fa-44d4-bf89-5abdeb734e01 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] HTTP exception thrown: Cannot 'detach_volume' instance 808abc0b-bb27-496f-8ce0-d536ab3d1ffb while it is in vm_state rescued Jan 19 16:05:40.307985 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d6175f58-e8fa-44d4-bf89-5abdeb734e01 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Returning 409 to user: Cannot 'detach_volume' instance 808abc0b-bb27-496f-8ce0-d536ab3d1ffb while it is in vm_state rescued {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:05:40.309033 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-d6175f58-e8fa-44d4-bf89-5abdeb734e01 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "DELETE /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments/e2a74569-e22e-4610-ab13-b92a383276fd" status: 409 len: 152 microversion: 2.1 time: 0.118677 Jan 19 16:05:40.309726 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 335/630] 10.222.0.58 () {58 vars in 1415 bytes} [Wed Jan 19 16:05:40 2022] DELETE /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments/e2a74569-e22e-4610-ab13-b92a383276fd => generated 152 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 19 16:05:40.318420 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-27aedf32-1453-436a-b0bb-a18be52dfba1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:40.318944 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-27aedf32-1453-436a-b0bb-a18be52dfba1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:40.326583 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-27aedf32-1453-436a-b0bb-a18be52dfba1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:40.331822 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-27aedf32-1453-436a-b0bb-a18be52dfba1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:40.332881 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-27aedf32-1453-436a-b0bb-a18be52dfba1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:40.333412 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-27aedf32-1453-436a-b0bb-a18be52dfba1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:40.531932 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-27aedf32-1453-436a-b0bb-a18be52dfba1 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "POST /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/action" status: 202 len: 0 microversion: 2.1 time: 0.216813 Jan 19 16:05:40.533293 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 296/631] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:40 2022] POST /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:05:40.541805 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-36e0daf5-241f-4be5-9f36-5953e41d0ce4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:40.542412 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-36e0daf5-241f-4be5-9f36-5953e41d0ce4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:40.552574 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-36e0daf5-241f-4be5-9f36-5953e41d0ce4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:40.553010 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-36e0daf5-241f-4be5-9f36-5953e41d0ce4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:40.553821 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-36e0daf5-241f-4be5-9f36-5953e41d0ce4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:40.554222 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-36e0daf5-241f-4be5-9f36-5953e41d0ce4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:40.719536 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-36e0daf5-241f-4be5-9f36-5953e41d0ce4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:40.730623 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-36e0daf5-241f-4be5-9f36-5953e41d0ce4 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1553 microversion: 2.1 time: 0.192631 Jan 19 16:05:40.731467 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 336/632] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:40 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1553 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:40.773575 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f0d31bdd-a424-4d19-aff2-a91d6a4bee20 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:40.774588 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-f0d31bdd-a424-4d19-aff2-a91d6a4bee20 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:40.781344 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f0d31bdd-a424-4d19-aff2-a91d6a4bee20 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:40.781786 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f0d31bdd-a424-4d19-aff2-a91d6a4bee20 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:40.784067 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f0d31bdd-a424-4d19-aff2-a91d6a4bee20 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:40.784067 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f0d31bdd-a424-4d19-aff2-a91d6a4bee20 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:40.791204 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3600a81a-c785-4d94-bd99-6ec77977682a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:40.792323 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3600a81a-c785-4d94-bd99-6ec77977682a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:40.799011 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3600a81a-c785-4d94-bd99-6ec77977682a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:40.799439 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3600a81a-c785-4d94-bd99-6ec77977682a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:40.800350 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3600a81a-c785-4d94-bd99-6ec77977682a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:40.801327 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3600a81a-c785-4d94-bd99-6ec77977682a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:43.838694 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f0d31bdd-a424-4d19-aff2-a91d6a4bee20 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 33769 microversion: 2.20 time: 3.069139 Jan 19 16:05:43.840400 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 297/633] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:40 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 33769 bytes in 3073 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:05:43.851968 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d76cbd2b-5236-4412-8e84-9463388c2c5b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:43.852705 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d76cbd2b-5236-4412-8e84-9463388c2c5b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:43.861772 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3600a81a-c785-4d94-bd99-6ec77977682a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 34389 microversion: 2.1 time: 3.073725 Jan 19 16:05:43.863818 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 337/634] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:40 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 34389 bytes in 3078 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:05:43.870802 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b9369bac-ff28-452f-84cf-903560c1448b tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:43.872284 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b9369bac-ff28-452f-84cf-903560c1448b tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:43.881685 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d76cbd2b-5236-4412-8e84-9463388c2c5b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:43.882471 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b9369bac-ff28-452f-84cf-903560c1448b tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:43.883229 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b9369bac-ff28-452f-84cf-903560c1448b tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:43.884453 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d76cbd2b-5236-4412-8e84-9463388c2c5b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:43.884600 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b9369bac-ff28-452f-84cf-903560c1448b tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:43.885375 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b9369bac-ff28-452f-84cf-903560c1448b tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:43.886048 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d76cbd2b-5236-4412-8e84-9463388c2c5b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:43.886807 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d76cbd2b-5236-4412-8e84-9463388c2c5b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:44.059861 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-b9369bac-ff28-452f-84cf-903560c1448b tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:44.069028 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b9369bac-ff28-452f-84cf-903560c1448b tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1502 microversion: 2.1 time: 0.203582 Jan 19 16:05:44.069631 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 338/635] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:43 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1502 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:44.074194 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3db01403-fef2-4348-ae0c-a1bcff3c03fa tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:44.074999 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3db01403-fef2-4348-ae0c-a1bcff3c03fa tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:44.082463 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3db01403-fef2-4348-ae0c-a1bcff3c03fa tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:44.082912 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3db01403-fef2-4348-ae0c-a1bcff3c03fa tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:44.083865 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3db01403-fef2-4348-ae0c-a1bcff3c03fa tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:44.084308 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3db01403-fef2-4348-ae0c-a1bcff3c03fa tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:44.233178 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-3db01403-fef2-4348-ae0c-a1bcff3c03fa tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:44.242634 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3db01403-fef2-4348-ae0c-a1bcff3c03fa tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1317 microversion: 2.1 time: 0.171794 Jan 19 16:05:44.252340 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 339/636] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:44 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:44.269750 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d76cbd2b-5236-4412-8e84-9463388c2c5b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:44.270136 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-54427dfe-8b91-4579-9e65-b67b462ed24a req-564be230-85e5-4989-94e8-4c4c96af4f9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a199868-949d-49fb-96e3-8c0befc8e20b", "name": "network-vif-plugged", "status": "completed", "tag": "31d41df4-bb41-486f-bc2f-3fbe182757f0"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:44.270136 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:05:44.270136 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:05:44.270382 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d76cbd2b-5236-4412-8e84-9463388c2c5b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1265 microversion: 2.1 time: 0.411829 Jan 19 16:05:44.270382 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 298/637] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:43 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1265 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:44.270532 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-54427dfe-8b91-4579-9e65-b67b462ed24a req-564be230-85e5-4989-94e8-4c4c96af4f9c service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:44.270532 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-54427dfe-8b91-4579-9e65-b67b462ed24a req-564be230-85e5-4989-94e8-4c4c96af4f9c service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:44.270681 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-01376817-161b-4356-a21d-6ba954142a7c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:44.270681 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-01376817-161b-4356-a21d-6ba954142a7c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:44.281237 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-54427dfe-8b91-4579-9e65-b67b462ed24a req-564be230-85e5-4989-94e8-4c4c96af4f9c service nova] Creating event network-vif-plugged:31d41df4-bb41-486f-bc2f-3fbe182757f0 for instance 2a199868-949d-49fb-96e3-8c0befc8e20b on hv-cinder-82002 Jan 19 16:05:44.284886 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-01376817-161b-4356-a21d-6ba954142a7c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:44.285338 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-01376817-161b-4356-a21d-6ba954142a7c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:44.286213 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-01376817-161b-4356-a21d-6ba954142a7c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:44.286650 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-01376817-161b-4356-a21d-6ba954142a7c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:44.288226 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-54427dfe-8b91-4579-9e65-b67b462ed24a req-564be230-85e5-4989-94e8-4c4c96af4f9c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043643 Jan 19 16:05:44.289060 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 340/638] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:05:44.523857 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-01376817-161b-4356-a21d-6ba954142a7c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:44.533905 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-01376817-161b-4356-a21d-6ba954142a7c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1553 microversion: 2.1 time: 0.272298 Jan 19 16:05:44.534869 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 299/639] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:44 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1553 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:44.853922 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-bca9bc5a-fa5c-496e-ac3b-6e7830408699 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:44.855845 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-bca9bc5a-fa5c-496e-ac3b-6e7830408699 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:44.862336 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bca9bc5a-fa5c-496e-ac3b-6e7830408699 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:44.863093 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bca9bc5a-fa5c-496e-ac3b-6e7830408699 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:44.863598 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bca9bc5a-fa5c-496e-ac3b-6e7830408699 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:44.864023 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bca9bc5a-fa5c-496e-ac3b-6e7830408699 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:44.878289 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-7454d509-c5df-4345-afbf-e98791afa796 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:44.879900 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-7454d509-c5df-4345-afbf-e98791afa796 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:44.886418 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7454d509-c5df-4345-afbf-e98791afa796 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:44.886854 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7454d509-c5df-4345-afbf-e98791afa796 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:44.887677 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7454d509-c5df-4345-afbf-e98791afa796 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:44.888107 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7454d509-c5df-4345-afbf-e98791afa796 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:45.514318 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-7454d509-c5df-4345-afbf-e98791afa796 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 34995 microversion: 2.1 time: 0.640599 Jan 19 16:05:45.515031 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 300/640] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:44 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 34995 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:05:45.520925 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6f6fa81b-ab4b-4a91-995c-f151ee1f533d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:45.521632 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-6f6fa81b-ab4b-4a91-995c-f151ee1f533d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:45.528972 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6f6fa81b-ab4b-4a91-995c-f151ee1f533d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:45.529387 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6f6fa81b-ab4b-4a91-995c-f151ee1f533d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:45.530190 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6f6fa81b-ab4b-4a91-995c-f151ee1f533d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:45.530657 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6f6fa81b-ab4b-4a91-995c-f151ee1f533d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:45.676405 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-bca9bc5a-fa5c-496e-ac3b-6e7830408699 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 34361 microversion: 2.20 time: 0.826316 Jan 19 16:05:45.678110 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 341/641] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:44 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 34361 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:05:45.691954 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-77ac324b-e417-4941-ab54-8ae683231697 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:45.693371 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-77ac324b-e417-4941-ab54-8ae683231697 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:45.697643 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6f6fa81b-ab4b-4a91-995c-f151ee1f533d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:45.704767 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-77ac324b-e417-4941-ab54-8ae683231697 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:45.709336 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-77ac324b-e417-4941-ab54-8ae683231697 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:45.709537 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6f6fa81b-ab4b-4a91-995c-f151ee1f533d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1502 microversion: 2.1 time: 0.189859 Jan 19 16:05:45.709537 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 301/642] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:45 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1502 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:45.709840 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-77ac324b-e417-4941-ab54-8ae683231697 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:45.709840 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-77ac324b-e417-4941-ab54-8ae683231697 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:45.711655 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-376091d7-cdcf-471e-8f47-bd3f461f3f88 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:45.712275 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-376091d7-cdcf-471e-8f47-bd3f461f3f88 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:45.718709 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-376091d7-cdcf-471e-8f47-bd3f461f3f88 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:45.719200 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-376091d7-cdcf-471e-8f47-bd3f461f3f88 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:45.720010 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-376091d7-cdcf-471e-8f47-bd3f461f3f88 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:45.721121 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-376091d7-cdcf-471e-8f47-bd3f461f3f88 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:45.920756 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-77ac324b-e417-4941-ab54-8ae683231697 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:45.934713 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-77ac324b-e417-4941-ab54-8ae683231697 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1317 microversion: 2.1 time: 0.254322 Jan 19 16:05:45.934928 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-376091d7-cdcf-471e-8f47-bd3f461f3f88 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:45.935786 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 342/643] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:45 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:45.943713 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-376091d7-cdcf-471e-8f47-bd3f461f3f88 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1265 microversion: 2.1 time: 0.235663 Jan 19 16:05:45.944040 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-4c84101f-5735-492e-a3ae-6443f6cbc41f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:45.944658 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 302/644] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:45 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:45.951705 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-4c84101f-5735-492e-a3ae-6443f6cbc41f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:45.959512 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4c84101f-5735-492e-a3ae-6443f6cbc41f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:45.959952 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4c84101f-5735-492e-a3ae-6443f6cbc41f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:45.960797 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4c84101f-5735-492e-a3ae-6443f6cbc41f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:45.961273 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4c84101f-5735-492e-a3ae-6443f6cbc41f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:46.103170 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-4c84101f-5735-492e-a3ae-6443f6cbc41f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:46.111380 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-4c84101f-5735-492e-a3ae-6443f6cbc41f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1553 microversion: 2.1 time: 0.174170 Jan 19 16:05:46.111966 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 343/645] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:45 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:46.530266 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-521f9a24-5688-4d9c-89d5-d98027c6a091 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:46.531291 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-521f9a24-5688-4d9c-89d5-d98027c6a091 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:46.538501 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-521f9a24-5688-4d9c-89d5-d98027c6a091 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:46.538932 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-521f9a24-5688-4d9c-89d5-d98027c6a091 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:46.539884 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-521f9a24-5688-4d9c-89d5-d98027c6a091 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:46.540883 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-521f9a24-5688-4d9c-89d5-d98027c6a091 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:46.694476 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-05c3cb03-beef-4c91-8dce-14e27323f464 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:46.695781 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-05c3cb03-beef-4c91-8dce-14e27323f464 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:46.704582 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-05c3cb03-beef-4c91-8dce-14e27323f464 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:46.705178 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-05c3cb03-beef-4c91-8dce-14e27323f464 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:46.705966 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-05c3cb03-beef-4c91-8dce-14e27323f464 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:46.706392 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-05c3cb03-beef-4c91-8dce-14e27323f464 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:46.744633 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-521f9a24-5688-4d9c-89d5-d98027c6a091 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 35341 microversion: 2.1 time: 0.219254 Jan 19 16:05:46.746129 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 303/646] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:46 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 35341 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:05:46.753691 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-8651af75-da04-403e-9d93-ebdcead2cf75 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:46.759751 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8651af75-da04-403e-9d93-ebdcead2cf75 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:46.762319 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8651af75-da04-403e-9d93-ebdcead2cf75 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:46.762784 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8651af75-da04-403e-9d93-ebdcead2cf75 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:46.763829 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8651af75-da04-403e-9d93-ebdcead2cf75 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:46.764258 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8651af75-da04-403e-9d93-ebdcead2cf75 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:46.892144 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-05c3cb03-beef-4c91-8dce-14e27323f464 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 34941 microversion: 2.20 time: 0.203285 Jan 19 16:05:46.893325 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 344/647] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:46 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 34941 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:05:46.953264 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8651af75-da04-403e-9d93-ebdcead2cf75 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:46.957604 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b17757a1-aef9-4739-8554-129db032a0e7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:46.958548 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b17757a1-aef9-4739-8554-129db032a0e7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:46.963833 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-8651af75-da04-403e-9d93-ebdcead2cf75 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1502 microversion: 2.1 time: 0.215326 Jan 19 16:05:46.963833 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 304/648] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:46 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1502 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:46.970679 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b17757a1-aef9-4739-8554-129db032a0e7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:46.980709 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b17757a1-aef9-4739-8554-129db032a0e7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:46.980709 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b17757a1-aef9-4739-8554-129db032a0e7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:46.980709 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b17757a1-aef9-4739-8554-129db032a0e7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:46.981251 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-0bd01517-769f-42f4-8974-b7d572843f1f tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:46.981251 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-0bd01517-769f-42f4-8974-b7d572843f1f tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:46.993050 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0bd01517-769f-42f4-8974-b7d572843f1f tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:46.994095 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0bd01517-769f-42f4-8974-b7d572843f1f tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:46.996589 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0bd01517-769f-42f4-8974-b7d572843f1f tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:46.998302 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0bd01517-769f-42f4-8974-b7d572843f1f tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:47.182686 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-b17757a1-aef9-4739-8554-129db032a0e7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:47.191253 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b17757a1-aef9-4739-8554-129db032a0e7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1317 microversion: 2.1 time: 0.240174 Jan 19 16:05:47.191864 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 345/649] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:46 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:47.196620 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-1045a021-df9b-4b2e-afd3-47e9ea7a0bd7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:47.197485 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-1045a021-df9b-4b2e-afd3-47e9ea7a0bd7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:47.204885 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1045a021-df9b-4b2e-afd3-47e9ea7a0bd7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:47.205653 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1045a021-df9b-4b2e-afd3-47e9ea7a0bd7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:47.206641 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1045a021-df9b-4b2e-afd3-47e9ea7a0bd7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:47.207259 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1045a021-df9b-4b2e-afd3-47e9ea7a0bd7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:47.247398 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-0bd01517-769f-42f4-8974-b7d572843f1f tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:47.257096 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-0bd01517-769f-42f4-8974-b7d572843f1f tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1265 microversion: 2.1 time: 0.291340 Jan 19 16:05:47.257884 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 305/650] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:46 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1265 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:47.384182 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-1045a021-df9b-4b2e-afd3-47e9ea7a0bd7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:47.394719 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-1045a021-df9b-4b2e-afd3-47e9ea7a0bd7 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1553 microversion: 2.1 time: 0.201782 Jan 19 16:05:47.405139 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 346/651] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:47 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1553 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:47.760320 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-27720902-d556-48d2-80e3-0c1710ba6e3d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:47.761401 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-27720902-d556-48d2-80e3-0c1710ba6e3d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:47.770861 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-27720902-d556-48d2-80e3-0c1710ba6e3d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:47.771398 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-27720902-d556-48d2-80e3-0c1710ba6e3d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:47.772236 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-27720902-d556-48d2-80e3-0c1710ba6e3d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:47.772680 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-27720902-d556-48d2-80e3-0c1710ba6e3d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:47.906062 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-9688aad1-f6da-4b27-bb8c-d205203fc7be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:47.907023 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-9688aad1-f6da-4b27-bb8c-d205203fc7be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:47.913977 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9688aad1-f6da-4b27-bb8c-d205203fc7be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:47.914730 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9688aad1-f6da-4b27-bb8c-d205203fc7be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:47.915875 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9688aad1-f6da-4b27-bb8c-d205203fc7be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:47.916348 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9688aad1-f6da-4b27-bb8c-d205203fc7be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:47.937449 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-27720902-d556-48d2-80e3-0c1710ba6e3d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 35889 microversion: 2.1 time: 0.181273 Jan 19 16:05:47.938414 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 306/652] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:47 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 35889 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:05:47.981829 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-179a88b8-150a-4100-b855-1e6dccce5321 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:47.982858 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-179a88b8-150a-4100-b855-1e6dccce5321 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:47.991486 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-179a88b8-150a-4100-b855-1e6dccce5321 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:47.992014 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-179a88b8-150a-4100-b855-1e6dccce5321 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:47.992954 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-179a88b8-150a-4100-b855-1e6dccce5321 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:47.993455 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-179a88b8-150a-4100-b855-1e6dccce5321 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:48.072872 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-9688aad1-f6da-4b27-bb8c-d205203fc7be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 35370 microversion: 2.20 time: 0.169912 Jan 19 16:05:48.074163 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 347/653] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:47 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 35370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:05:48.219852 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ff8a187f-b8e7-4ab9-8540-caf6609e969a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:48.221303 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ff8a187f-b8e7-4ab9-8540-caf6609e969a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:48.232040 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ff8a187f-b8e7-4ab9-8540-caf6609e969a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:48.233019 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ff8a187f-b8e7-4ab9-8540-caf6609e969a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:48.233854 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ff8a187f-b8e7-4ab9-8540-caf6609e969a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:48.234383 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ff8a187f-b8e7-4ab9-8540-caf6609e969a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:48.358206 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-179a88b8-150a-4100-b855-1e6dccce5321 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:48.362776 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-179a88b8-150a-4100-b855-1e6dccce5321 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1502 microversion: 2.1 time: 0.385500 Jan 19 16:05:48.372752 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 307/654] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:47 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1502 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:48.377995 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-8b8b617a-cbae-4594-9551-978023bd295a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:48.379010 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8b8b617a-cbae-4594-9551-978023bd295a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:48.385774 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8b8b617a-cbae-4594-9551-978023bd295a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:48.386593 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8b8b617a-cbae-4594-9551-978023bd295a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:48.387987 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8b8b617a-cbae-4594-9551-978023bd295a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:48.388191 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8b8b617a-cbae-4594-9551-978023bd295a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:48.457257 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ff8a187f-b8e7-4ab9-8540-caf6609e969a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:48.470124 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ff8a187f-b8e7-4ab9-8540-caf6609e969a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1317 microversion: 2.1 time: 0.258955 Jan 19 16:05:48.487894 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 348/655] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:48 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:05:48.487894 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-34e631ca-8a0d-4379-9059-0bd79f1d6a23 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:48.487894 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-34e631ca-8a0d-4379-9059-0bd79f1d6a23 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:48.487894 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-34e631ca-8a0d-4379-9059-0bd79f1d6a23 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:48.488411 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-34e631ca-8a0d-4379-9059-0bd79f1d6a23 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:48.488411 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-34e631ca-8a0d-4379-9059-0bd79f1d6a23 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:48.488411 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-34e631ca-8a0d-4379-9059-0bd79f1d6a23 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:48.655160 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8b8b617a-cbae-4594-9551-978023bd295a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:48.663729 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-8b8b617a-cbae-4594-9551-978023bd295a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1452 microversion: 2.1 time: 0.289385 Jan 19 16:05:48.664686 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 308/656] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:48 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1452 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:48.670066 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-34e631ca-8a0d-4379-9059-0bd79f1d6a23 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:48.670719 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-a4a6325a-dbf5-45ef-a6cd-8cd68c781b4e req-00572d2b-1f18-40df-a71b-074050320a7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6452b53-f8fd-4bcf-853a-b6cba80219d3", "name": "network-vif-plugged", "status": "completed", "tag": "5398f5fc-b5dc-409d-a1d1-0ea421ad4c6a"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:48.672435 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:05:48.672435 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:05:48.684416 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-a4a6325a-dbf5-45ef-a6cd-8cd68c781b4e req-00572d2b-1f18-40df-a71b-074050320a7a service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:48.685239 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-a4a6325a-dbf5-45ef-a6cd-8cd68c781b4e req-00572d2b-1f18-40df-a71b-074050320a7a service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:48.703670 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-34e631ca-8a0d-4379-9059-0bd79f1d6a23 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1553 microversion: 2.1 time: 0.231184 Jan 19 16:05:48.705126 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 349/657] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:48 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1553 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:48.709965 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-a4a6325a-dbf5-45ef-a6cd-8cd68c781b4e req-00572d2b-1f18-40df-a71b-074050320a7a service nova] Creating event network-vif-plugged:5398f5fc-b5dc-409d-a1d1-0ea421ad4c6a for instance d6452b53-f8fd-4bcf-853a-b6cba80219d3 on hv-cinder-82002 Jan 19 16:05:48.721046 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-a4a6325a-dbf5-45ef-a6cd-8cd68c781b4e req-00572d2b-1f18-40df-a71b-074050320a7a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053856 Jan 19 16:05:48.722878 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 309/658] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:05:48.724711 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e5eed45f-9512-40da-8528-c4461dd1d58e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:48.725537 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-e5eed45f-9512-40da-8528-c4461dd1d58e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:48.736809 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e5eed45f-9512-40da-8528-c4461dd1d58e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:48.737654 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e5eed45f-9512-40da-8528-c4461dd1d58e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:48.739188 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e5eed45f-9512-40da-8528-c4461dd1d58e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:48.740087 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e5eed45f-9512-40da-8528-c4461dd1d58e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:48.951973 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e5eed45f-9512-40da-8528-c4461dd1d58e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:48.953810 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-aae7a854-0179-4c89-8467-9b5a9c52cfa6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:48.954768 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-aae7a854-0179-4c89-8467-9b5a9c52cfa6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:48.961628 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-aae7a854-0179-4c89-8467-9b5a9c52cfa6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:48.962076 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-aae7a854-0179-4c89-8467-9b5a9c52cfa6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:48.962895 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-aae7a854-0179-4c89-8467-9b5a9c52cfa6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:48.963369 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-aae7a854-0179-4c89-8467-9b5a9c52cfa6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:48.964635 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e5eed45f-9512-40da-8528-c4461dd1d58e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1452 microversion: 2.1 time: 0.258054 Jan 19 16:05:48.965356 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 350/659] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:48 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1452 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:49.088722 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b8a20f8b-2824-4af0-bf95-b0a07bc1005e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:49.090505 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b8a20f8b-2824-4af0-bf95-b0a07bc1005e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:49.100882 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b8a20f8b-2824-4af0-bf95-b0a07bc1005e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:49.101494 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b8a20f8b-2824-4af0-bf95-b0a07bc1005e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:49.103003 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b8a20f8b-2824-4af0-bf95-b0a07bc1005e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:49.104082 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b8a20f8b-2824-4af0-bf95-b0a07bc1005e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:49.557107 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b8a20f8b-2824-4af0-bf95-b0a07bc1005e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 36847 microversion: 2.20 time: 0.472592 Jan 19 16:05:49.559478 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 351/660] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:49 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 36847 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:05:49.567116 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-cc9bf135-3a5d-4d26-823c-2cf6c6476695 req-e3c13da7-2d2d-490a-a1d4-05b18249fa1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e48fec90-7f72-4519-b6cf-dfcdc0c8225f", "name": "network-vif-deleted", "tag": "f7b41b1e-9a19-457c-8074-1c6e8e142c6e"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:49.569498 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:05:49.569498 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:05:49.577849 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-aae7a854-0179-4c89-8467-9b5a9c52cfa6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 37674 microversion: 2.1 time: 0.627719 Jan 19 16:05:49.578770 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 310/661] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:48 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 37674 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:05:49.591483 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-cc9bf135-3a5d-4d26-823c-2cf6c6476695 req-e3c13da7-2d2d-490a-a1d4-05b18249fa1a service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:49.592628 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-cc9bf135-3a5d-4d26-823c-2cf6c6476695 req-e3c13da7-2d2d-490a-a1d4-05b18249fa1a service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:49.598954 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6d68b689-62c6-4a31-9e9f-7cb90581f8c0 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:49.599712 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-6d68b689-62c6-4a31-9e9f-7cb90581f8c0 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:49.613571 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6d68b689-62c6-4a31-9e9f-7cb90581f8c0 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:49.614094 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6d68b689-62c6-4a31-9e9f-7cb90581f8c0 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:49.614952 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6d68b689-62c6-4a31-9e9f-7cb90581f8c0 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:49.615383 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6d68b689-62c6-4a31-9e9f-7cb90581f8c0 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:49.627506 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-cc9bf135-3a5d-4d26-823c-2cf6c6476695 req-e3c13da7-2d2d-490a-a1d4-05b18249fa1a service nova] Creating event network-vif-deleted:f7b41b1e-9a19-457c-8074-1c6e8e142c6e for instance e48fec90-7f72-4519-b6cf-dfcdc0c8225f on hv-cinder-82002 Jan 19 16:05:49.639503 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-cc9bf135-3a5d-4d26-823c-2cf6c6476695 req-e3c13da7-2d2d-490a-a1d4-05b18249fa1a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078153 Jan 19 16:05:49.640777 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 352/662] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:05:49.650852 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-031ed576-6425-48d5-a726-690ea9987817 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:49.652465 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-031ed576-6425-48d5-a726-690ea9987817 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:49.665417 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-031ed576-6425-48d5-a726-690ea9987817 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:49.666148 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-031ed576-6425-48d5-a726-690ea9987817 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:49.667587 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-031ed576-6425-48d5-a726-690ea9987817 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:49.668334 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-031ed576-6425-48d5-a726-690ea9987817 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:49.716697 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6d68b689-62c6-4a31-9e9f-7cb90581f8c0 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:49.734274 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6d68b689-62c6-4a31-9e9f-7cb90581f8c0 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1460 microversion: 2.1 time: 0.153007 Jan 19 16:05:49.735305 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 311/663] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:49 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1460 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:49.743758 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-fa3968db-5217-4ad2-8e5f-0f6e26f16d10 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:49.744803 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-fa3968db-5217-4ad2-8e5f-0f6e26f16d10 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:49.760189 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fa3968db-5217-4ad2-8e5f-0f6e26f16d10 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:49.761031 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fa3968db-5217-4ad2-8e5f-0f6e26f16d10 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:49.762468 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fa3968db-5217-4ad2-8e5f-0f6e26f16d10 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:49.763309 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fa3968db-5217-4ad2-8e5f-0f6e26f16d10 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:49.878218 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-031ed576-6425-48d5-a726-690ea9987817 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:49.888644 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-031ed576-6425-48d5-a726-690ea9987817 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1317 microversion: 2.1 time: 0.245156 Jan 19 16:05:49.898070 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 353/664] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:49 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:49.962512 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-fa3968db-5217-4ad2-8e5f-0f6e26f16d10 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:49.978313 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-fa3968db-5217-4ad2-8e5f-0f6e26f16d10 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1553 microversion: 2.1 time: 0.240858 Jan 19 16:05:49.983982 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 312/665] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:49 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1553 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:50.572020 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ec4c91b1-9c3e-4aa9-bf18-a512eeb7b4c2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:50.572930 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ec4c91b1-9c3e-4aa9-bf18-a512eeb7b4c2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:50.579655 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ec4c91b1-9c3e-4aa9-bf18-a512eeb7b4c2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:50.580096 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ec4c91b1-9c3e-4aa9-bf18-a512eeb7b4c2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:50.580893 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ec4c91b1-9c3e-4aa9-bf18-a512eeb7b4c2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:50.581320 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ec4c91b1-9c3e-4aa9-bf18-a512eeb7b4c2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:50.592652 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e444a92f-42bc-44a8-82ed-08ec16fce45b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:50.593637 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-e444a92f-42bc-44a8-82ed-08ec16fce45b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:50.611719 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e444a92f-42bc-44a8-82ed-08ec16fce45b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:50.613318 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e444a92f-42bc-44a8-82ed-08ec16fce45b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:50.615190 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e444a92f-42bc-44a8-82ed-08ec16fce45b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:50.615926 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e444a92f-42bc-44a8-82ed-08ec16fce45b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:53.929077 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:05:53.929892 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: Wed Jan 19 16:05:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action (ip 10.222.0.58) !!! Jan 19 16:05:53.961140 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e444a92f-42bc-44a8-82ed-08ec16fce45b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 38083 microversion: 2.1 time: 3.371753 Jan 19 16:05:53.962382 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 313/666] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:50 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 38083 bytes in 3374 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:05:53.968739 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-232bcfe6-7d56-4a1e-82d9-21b414be7055 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:53.969436 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-232bcfe6-7d56-4a1e-82d9-21b414be7055 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:53.976871 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-232bcfe6-7d56-4a1e-82d9-21b414be7055 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:53.977417 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-232bcfe6-7d56-4a1e-82d9-21b414be7055 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:53.978218 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-232bcfe6-7d56-4a1e-82d9-21b414be7055 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:53.978687 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-232bcfe6-7d56-4a1e-82d9-21b414be7055 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:54.025829 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ec4c91b1-9c3e-4aa9-bf18-a512eeb7b4c2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 38169 microversion: 2.20 time: 3.457099 Jan 19 16:05:54.027668 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 354/667] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:50 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 38169 bytes in 3460 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:05:54.035005 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-dd10040e-3d60-47db-9dcb-65600f870cd6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:54.035819 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-dd10040e-3d60-47db-9dcb-65600f870cd6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:54.045626 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dd10040e-3d60-47db-9dcb-65600f870cd6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:54.046094 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dd10040e-3d60-47db-9dcb-65600f870cd6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:54.047188 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dd10040e-3d60-47db-9dcb-65600f870cd6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:54.047628 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dd10040e-3d60-47db-9dcb-65600f870cd6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:54.056182 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-232bcfe6-7d56-4a1e-82d9-21b414be7055 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:54.075728 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-232bcfe6-7d56-4a1e-82d9-21b414be7055 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1298 microversion: 2.1 time: 0.111553 Jan 19 16:05:54.081944 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 314/668] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:53 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1298 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:54.081944 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f106d010-1732-48b0-8c4a-dd6c27e005a8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:54.081944 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-f106d010-1732-48b0-8c4a-dd6c27e005a8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:54.088852 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f106d010-1732-48b0-8c4a-dd6c27e005a8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:54.089457 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f106d010-1732-48b0-8c4a-dd6c27e005a8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:54.090468 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f106d010-1732-48b0-8c4a-dd6c27e005a8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:54.091068 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f106d010-1732-48b0-8c4a-dd6c27e005a8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:54.301687 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-dd10040e-3d60-47db-9dcb-65600f870cd6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:54.307122 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-f106d010-1732-48b0-8c4a-dd6c27e005a8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:54.316626 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f106d010-1732-48b0-8c4a-dd6c27e005a8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1553 microversion: 2.1 time: 0.239119 Jan 19 16:05:54.317212 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 315/669] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:54 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1553 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:54.321939 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-0030a782-edbd-41c0-a161-2c492ec07639 req-829ab3e2-65ff-463b-a026-864c5aeed890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a199868-949d-49fb-96e3-8c0befc8e20b", "tag": "31d41df4-bb41-486f-bc2f-3fbe182757f0"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:54.323574 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:05:54.323574 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:05:54.329330 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-dd10040e-3d60-47db-9dcb-65600f870cd6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1317 microversion: 2.1 time: 0.300540 Jan 19 16:05:54.329910 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 355/670] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:54 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1317 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:54.334937 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-0030a782-edbd-41c0-a161-2c492ec07639 req-829ab3e2-65ff-463b-a026-864c5aeed890 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:54.339669 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-0030a782-edbd-41c0-a161-2c492ec07639 req-829ab3e2-65ff-463b-a026-864c5aeed890 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:54.359523 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-0030a782-edbd-41c0-a161-2c492ec07639 req-829ab3e2-65ff-463b-a026-864c5aeed890 service nova] Creating event network-changed:31d41df4-bb41-486f-bc2f-3fbe182757f0 for instance 2a199868-949d-49fb-96e3-8c0befc8e20b on hv-cinder-82002 Jan 19 16:05:54.362015 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-0030a782-edbd-41c0-a161-2c492ec07639 req-829ab3e2-65ff-463b-a026-864c5aeed890 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043176 Jan 19 16:05:54.362705 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 316/671] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:05:54.977253 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-eb80dde5-d060-4d66-b266-c018e144072c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:54.978948 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-eb80dde5-d060-4d66-b266-c018e144072c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:54.987375 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-eb80dde5-d060-4d66-b266-c018e144072c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:54.988462 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-eb80dde5-d060-4d66-b266-c018e144072c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:54.989348 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-eb80dde5-d060-4d66-b266-c018e144072c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:54.989771 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-eb80dde5-d060-4d66-b266-c018e144072c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:55.040754 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-3768c56d-46b3-4aa4-99e5-a998572c6681 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:55.042113 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-3768c56d-46b3-4aa4-99e5-a998572c6681 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:55.050310 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3768c56d-46b3-4aa4-99e5-a998572c6681 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:55.050775 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3768c56d-46b3-4aa4-99e5-a998572c6681 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:55.051677 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3768c56d-46b3-4aa4-99e5-a998572c6681 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:55.052483 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3768c56d-46b3-4aa4-99e5-a998572c6681 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:55.104075 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-eb80dde5-d060-4d66-b266-c018e144072c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 38083 microversion: 2.1 time: 0.131286 Jan 19 16:05:55.105331 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 356/672] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:54 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 38083 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:05:55.113571 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a4282056-3cd1-4225-85c2-34e066f0607d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:55.114580 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a4282056-3cd1-4225-85c2-34e066f0607d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:55.124892 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a4282056-3cd1-4225-85c2-34e066f0607d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:55.125709 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a4282056-3cd1-4225-85c2-34e066f0607d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:55.127614 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a4282056-3cd1-4225-85c2-34e066f0607d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:55.128214 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a4282056-3cd1-4225-85c2-34e066f0607d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:55.142052 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-3768c56d-46b3-4aa4-99e5-a998572c6681 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 38169 microversion: 2.20 time: 0.105678 Jan 19 16:05:55.143716 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 317/673] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:55 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 38169 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:05:55.178173 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a4282056-3cd1-4225-85c2-34e066f0607d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:55.178612 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a4282056-3cd1-4225-85c2-34e066f0607d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:55.179265 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.objects.instance [None req-a4282056-3cd1-4225-85c2-34e066f0607d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lazy-loading 'fault' on Instance uuid e48fec90-7f72-4519-b6cf-dfcdc0c8225f {{(pid=128876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:05:55.230550 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a4282056-3cd1-4225-85c2-34e066f0607d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c9613f79684051a2f0465852b5bfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0fa3bcd1c4abda9016798b037bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:55.240327 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a4282056-3cd1-4225-85c2-34e066f0607d tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 200 len: 1303 microversion: 2.1 time: 0.133260 Jan 19 16:05:55.241108 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 357/674] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:55 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 1303 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:55.337297 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-9042b751-630e-498b-abda-4a45e3b69848 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:55.338015 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-9042b751-630e-498b-abda-4a45e3b69848 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:55.345890 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9042b751-630e-498b-abda-4a45e3b69848 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:55.346333 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9042b751-630e-498b-abda-4a45e3b69848 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:55.347538 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9042b751-630e-498b-abda-4a45e3b69848 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:55.347965 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9042b751-630e-498b-abda-4a45e3b69848 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:55.356232 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-51c1c03a-f018-4456-8474-a12908555ac1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:55.357150 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-51c1c03a-f018-4456-8474-a12908555ac1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:55.368328 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-51c1c03a-f018-4456-8474-a12908555ac1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:55.368925 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-51c1c03a-f018-4456-8474-a12908555ac1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:55.370223 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-51c1c03a-f018-4456-8474-a12908555ac1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:55.370756 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-51c1c03a-f018-4456-8474-a12908555ac1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:55.531799 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-51c1c03a-f018-4456-8474-a12908555ac1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:55.537255 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-9042b751-630e-498b-abda-4a45e3b69848 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:55.542423 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-51c1c03a-f018-4456-8474-a12908555ac1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1317 microversion: 2.1 time: 0.190762 Jan 19 16:05:55.543076 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 358/675] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:55 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:05:55.546031 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-9042b751-630e-498b-abda-4a45e3b69848 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1559 microversion: 2.1 time: 0.212791 Jan 19 16:05:55.546628 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 318/676] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:55 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:55.633973 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-dc5e7f06-ea77-4e4e-bf5a-6b9679b13b0f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:55.634591 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-dc5e7f06-ea77-4e4e-bf5a-6b9679b13b0f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:55.644615 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dc5e7f06-ea77-4e4e-bf5a-6b9679b13b0f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:55.645390 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dc5e7f06-ea77-4e4e-bf5a-6b9679b13b0f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:55.646869 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dc5e7f06-ea77-4e4e-bf5a-6b9679b13b0f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:55.647712 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dc5e7f06-ea77-4e4e-bf5a-6b9679b13b0f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:55.762815 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.objects.instance [None req-dc5e7f06-ea77-4e4e-bf5a-6b9679b13b0f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lazy-loading 'services' on Instance uuid 808abc0b-bb27-496f-8ce0-d536ab3d1ffb {{(pid=128876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:05:56.071582 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-dc5e7f06-ea77-4e4e-bf5a-6b9679b13b0f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "DELETE /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments/e2a74569-e22e-4610-ab13-b92a383276fd" status: 202 len: 0 microversion: 2.1 time: 0.441350 Jan 19 16:05:56.072300 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 359/677] 10.222.0.58 () {58 vars in 1415 bytes} [Wed Jan 19 16:05:55 2022] DELETE /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments/e2a74569-e22e-4610-ab13-b92a383276fd => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:05:56.082291 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-97acaf7b-fc9f-40fb-851c-21f1bdd9cb49 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:56.083238 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-97acaf7b-fc9f-40fb-851c-21f1bdd9cb49 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:56.089962 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-97acaf7b-fc9f-40fb-851c-21f1bdd9cb49 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:56.090395 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-97acaf7b-fc9f-40fb-851c-21f1bdd9cb49 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:56.091268 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-97acaf7b-fc9f-40fb-851c-21f1bdd9cb49 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:56.098380 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-97acaf7b-fc9f-40fb-851c-21f1bdd9cb49 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:56.117050 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-373577ff-d360-4025-93b5-cf92d2e6c558 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:56.118171 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-373577ff-d360-4025-93b5-cf92d2e6c558 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:56.124724 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-373577ff-d360-4025-93b5-cf92d2e6c558 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:56.125160 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-373577ff-d360-4025-93b5-cf92d2e6c558 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:56.126539 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-373577ff-d360-4025-93b5-cf92d2e6c558 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:56.126899 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-373577ff-d360-4025-93b5-cf92d2e6c558 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:56.137077 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-97acaf7b-fc9f-40fb-851c-21f1bdd9cb49 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059617 Jan 19 16:05:56.138095 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 319/678] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:05:56 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:05:56.156693 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-1cb2335c-c6fb-4b9c-8d1d-beaddfbe3cf9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:05:56.158138 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-1cb2335c-c6fb-4b9c-8d1d-beaddfbe3cf9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:56.164494 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1cb2335c-c6fb-4b9c-8d1d-beaddfbe3cf9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:56.164942 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1cb2335c-c6fb-4b9c-8d1d-beaddfbe3cf9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:56.165740 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1cb2335c-c6fb-4b9c-8d1d-beaddfbe3cf9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:56.166175 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1cb2335c-c6fb-4b9c-8d1d-beaddfbe3cf9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:58.807660 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-373577ff-d360-4025-93b5-cf92d2e6c558 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 200 len: 38214 microversion: 2.1 time: 2.693952 Jan 19 16:05:58.808146 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 360/679] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:05:56 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 38214 bytes in 2696 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:05:58.812780 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8a3cf121-1e44-44e3-aef6-30821847a199 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:58.813491 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-8a3cf121-1e44-44e3-aef6-30821847a199 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] [instance: e48fec90-7f72-4519-b6cf-dfcdc0c8225f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:58.820586 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8a3cf121-1e44-44e3-aef6-30821847a199 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:58.821026 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8a3cf121-1e44-44e3-aef6-30821847a199 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:58.821926 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8a3cf121-1e44-44e3-aef6-30821847a199 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:58.822379 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8a3cf121-1e44-44e3-aef6-30821847a199 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:58.838036 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.wsgi [None req-8a3cf121-1e44-44e3-aef6-30821847a199 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] HTTP exception thrown: Instance e48fec90-7f72-4519-b6cf-dfcdc0c8225f could not be found. Jan 19 16:05:58.838598 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8a3cf121-1e44-44e3-aef6-30821847a199 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] Returning 404 to user: Instance e48fec90-7f72-4519-b6cf-dfcdc0c8225f could not be found. {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:05:58.839470 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-8a3cf121-1e44-44e3-aef6-30821847a199 tempest-VolumesActionsTest-278806809 tempest-VolumesActionsTest-278806809-project] 10.222.0.58 "GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f" status: 404 len: 111 microversion: 2.1 time: 0.030657 Jan 19 16:05:58.840046 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 361/680] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:58 2022] GET /compute/v2.1/servers/e48fec90-7f72-4519-b6cf-dfcdc0c8225f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:05:58.847541 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-397b35ee-a0ee-43be-acc6-95f0a79dc034 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:58.847541 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-397b35ee-a0ee-43be-acc6-95f0a79dc034 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:58.855705 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-397b35ee-a0ee-43be-acc6-95f0a79dc034 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:58.857538 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-397b35ee-a0ee-43be-acc6-95f0a79dc034 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:58.857538 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-397b35ee-a0ee-43be-acc6-95f0a79dc034 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:58.857866 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-397b35ee-a0ee-43be-acc6-95f0a79dc034 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:59.031739 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-397b35ee-a0ee-43be-acc6-95f0a79dc034 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:05:59.041667 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-397b35ee-a0ee-43be-acc6-95f0a79dc034 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1317 microversion: 2.1 time: 0.200557 Jan 19 16:05:59.042260 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 362/681] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:05:58 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:05:59.046899 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b398a322-8b20-40ff-ae8b-92226259b18f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:59.054325 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b398a322-8b20-40ff-ae8b-92226259b18f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:59.056494 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b398a322-8b20-40ff-ae8b-92226259b18f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:59.057309 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b398a322-8b20-40ff-ae8b-92226259b18f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:59.058743 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b398a322-8b20-40ff-ae8b-92226259b18f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:59.059567 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b398a322-8b20-40ff-ae8b-92226259b18f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:59.094801 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b398a322-8b20-40ff-ae8b-92226259b18f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051395 Jan 19 16:05:59.095412 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 363/682] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:05:59 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:05:59.100054 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-56a65b3a-0811-461c-b52b-076d98ab9032 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:05:59.100540 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-56a65b3a-0811-461c-b52b-076d98ab9032 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:05:59.106680 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-56a65b3a-0811-461c-b52b-076d98ab9032 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:59.107173 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-56a65b3a-0811-461c-b52b-076d98ab9032 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:59.108041 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-56a65b3a-0811-461c-b52b-076d98ab9032 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:05:59.108520 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-56a65b3a-0811-461c-b52b-076d98ab9032 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:05:59.136387 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-56a65b3a-0811-461c-b52b-076d98ab9032 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/ips" status: 200 len: 146 microversion: 2.1 time: 0.039839 Jan 19 16:05:59.137197 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 364/683] 10.222.0.58 () {58 vars in 1247 bytes} [Wed Jan 19 16:05:59 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:06:00.060862 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-12e74b85-856e-4772-9536-503875857b29 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:00.061880 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-12e74b85-856e-4772-9536-503875857b29 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:00.072315 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-12e74b85-856e-4772-9536-503875857b29 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:00.072797 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-12e74b85-856e-4772-9536-503875857b29 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:00.073618 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-12e74b85-856e-4772-9536-503875857b29 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:00.074159 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-12e74b85-856e-4772-9536-503875857b29 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:00.209957 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-12e74b85-856e-4772-9536-503875857b29 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:00.217756 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-12e74b85-856e-4772-9536-503875857b29 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1317 microversion: 2.1 time: 0.162977 Jan 19 16:06:00.218382 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 365/684] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:00 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:00.223538 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-9a29f60e-24d2-49b5-8b02-ac4c481a437a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:00.224449 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-9a29f60e-24d2-49b5-8b02-ac4c481a437a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:00.230743 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9a29f60e-24d2-49b5-8b02-ac4c481a437a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:00.231217 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9a29f60e-24d2-49b5-8b02-ac4c481a437a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:00.232055 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9a29f60e-24d2-49b5-8b02-ac4c481a437a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:00.232540 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9a29f60e-24d2-49b5-8b02-ac4c481a437a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:00.268152 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-9a29f60e-24d2-49b5-8b02-ac4c481a437a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048567 Jan 19 16:06:00.269110 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 366/685] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:06:00 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:06:00.356058 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-1cb2335c-c6fb-4b9c-8d1d-beaddfbe3cf9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 200 len: 38308 microversion: 2.20 time: 4.203437 Jan 19 16:06:00.356712 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 320/686] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:05:56 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 38308 bytes in 4205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:06:00.367140 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-4de34631-19c5-43b1-bd00-1fc9a8d3a326 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:00.367625 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-4de34631-19c5-43b1-bd00-1fc9a8d3a326 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:00.373766 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4de34631-19c5-43b1-bd00-1fc9a8d3a326 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:00.374211 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4de34631-19c5-43b1-bd00-1fc9a8d3a326 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:00.375024 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4de34631-19c5-43b1-bd00-1fc9a8d3a326 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:00.375459 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4de34631-19c5-43b1-bd00-1fc9a8d3a326 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:00.400382 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-4de34631-19c5-43b1-bd00-1fc9a8d3a326 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/ips" status: 200 len: 151 microversion: 2.20 time: 0.037152 Jan 19 16:06:00.400978 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 367/687] 10.222.0.58 () {60 vars in 1288 bytes} [Wed Jan 19 16:06:00 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:06:01.240222 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-1dc36f9c-e80b-4154-9c15-745413df4dcd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:01.241527 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-1dc36f9c-e80b-4154-9c15-745413df4dcd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:01.253813 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1dc36f9c-e80b-4154-9c15-745413df4dcd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:01.254620 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1dc36f9c-e80b-4154-9c15-745413df4dcd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:01.255977 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1dc36f9c-e80b-4154-9c15-745413df4dcd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:01.256600 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1dc36f9c-e80b-4154-9c15-745413df4dcd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:01.280208 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ac096541-0631-44ab-ad84-1ddf4ac202ff tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:01.281157 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ac096541-0631-44ab-ad84-1ddf4ac202ff tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:01.289780 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ac096541-0631-44ab-ad84-1ddf4ac202ff tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:01.290828 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ac096541-0631-44ab-ad84-1ddf4ac202ff tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:01.291697 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ac096541-0631-44ab-ad84-1ddf4ac202ff tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:01.292402 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ac096541-0631-44ab-ad84-1ddf4ac202ff tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:01.337982 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ac096541-0631-44ab-ad84-1ddf4ac202ff tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061384 Jan 19 16:06:01.339365 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 368/688] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:06:01 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:06:01.454109 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-1dc36f9c-e80b-4154-9c15-745413df4dcd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:01.467023 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-1dc36f9c-e80b-4154-9c15-745413df4dcd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1317 microversion: 2.1 time: 0.234184 Jan 19 16:06:01.468082 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 321/689] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:01 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:02.358450 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-0ef2a9e5-541e-48be-a753-3fe158d622b8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:02.360171 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-0ef2a9e5-541e-48be-a753-3fe158d622b8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:02.366578 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0ef2a9e5-541e-48be-a753-3fe158d622b8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:02.367076 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0ef2a9e5-541e-48be-a753-3fe158d622b8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:02.367878 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0ef2a9e5-541e-48be-a753-3fe158d622b8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:02.368315 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0ef2a9e5-541e-48be-a753-3fe158d622b8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:02.409500 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-0ef2a9e5-541e-48be-a753-3fe158d622b8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056964 Jan 19 16:06:02.417476 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 369/690] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:06:02 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:06:02.488500 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-3c66d265-28ef-4e6b-9b1e-3471a2436e8f tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:02.489906 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-3c66d265-28ef-4e6b-9b1e-3471a2436e8f tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:02.499398 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3c66d265-28ef-4e6b-9b1e-3471a2436e8f tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:02.499845 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3c66d265-28ef-4e6b-9b1e-3471a2436e8f tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:02.500931 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3c66d265-28ef-4e6b-9b1e-3471a2436e8f tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:02.501433 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3c66d265-28ef-4e6b-9b1e-3471a2436e8f tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:02.649535 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-3c66d265-28ef-4e6b-9b1e-3471a2436e8f tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:02.658074 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-3c66d265-28ef-4e6b-9b1e-3471a2436e8f tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1507 microversion: 2.1 time: 0.175480 Jan 19 16:06:02.658678 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 322/691] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:02 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:03.428887 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5c125313-7de7-4949-a503-744680cbff91 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:03.430109 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5c125313-7de7-4949-a503-744680cbff91 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:03.437761 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5c125313-7de7-4949-a503-744680cbff91 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:03.438416 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5c125313-7de7-4949-a503-744680cbff91 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:03.439486 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5c125313-7de7-4949-a503-744680cbff91 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:03.440325 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5c125313-7de7-4949-a503-744680cbff91 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:03.500616 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5c125313-7de7-4949-a503-744680cbff91 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075298 Jan 19 16:06:03.502743 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 370/692] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:06:03 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:06:04.516208 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-0242d12b-282a-4406-afbe-8431aefd6961 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:04.517185 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-0242d12b-282a-4406-afbe-8431aefd6961 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:04.528438 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0242d12b-282a-4406-afbe-8431aefd6961 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:04.528871 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0242d12b-282a-4406-afbe-8431aefd6961 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:04.529850 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0242d12b-282a-4406-afbe-8431aefd6961 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:04.530376 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0242d12b-282a-4406-afbe-8431aefd6961 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:04.567115 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-0242d12b-282a-4406-afbe-8431aefd6961 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054707 Jan 19 16:06:04.571216 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 323/693] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:06:04 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:06:05.578785 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-15f0a621-3205-4be3-a17b-5a31fdffe718 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:05.579800 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-15f0a621-3205-4be3-a17b-5a31fdffe718 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:05.586445 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-15f0a621-3205-4be3-a17b-5a31fdffe718 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:05.586894 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-15f0a621-3205-4be3-a17b-5a31fdffe718 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:05.587767 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-15f0a621-3205-4be3-a17b-5a31fdffe718 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:05.588199 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-15f0a621-3205-4be3-a17b-5a31fdffe718 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:05.623593 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-15f0a621-3205-4be3-a17b-5a31fdffe718 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047898 Jan 19 16:06:05.624318 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 371/694] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:06:05 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:06:06.637516 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c28a66ca-0625-461c-9db4-ca56425c0a78 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:06.638445 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c28a66ca-0625-461c-9db4-ca56425c0a78 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:06.645719 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c28a66ca-0625-461c-9db4-ca56425c0a78 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:06.646154 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c28a66ca-0625-461c-9db4-ca56425c0a78 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:06.646943 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c28a66ca-0625-461c-9db4-ca56425c0a78 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:06.647398 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c28a66ca-0625-461c-9db4-ca56425c0a78 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:06.680048 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c28a66ca-0625-461c-9db4-ca56425c0a78 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046185 Jan 19 16:06:06.680631 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 324/695] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:06:06 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:06:07.694734 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-071d4a98-8e2c-40c8-9d92-d5b3344549ec tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:07.696012 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-071d4a98-8e2c-40c8-9d92-d5b3344549ec tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:07.703188 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-071d4a98-8e2c-40c8-9d92-d5b3344549ec tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:07.703647 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-071d4a98-8e2c-40c8-9d92-d5b3344549ec tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:07.704976 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-071d4a98-8e2c-40c8-9d92-d5b3344549ec tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:07.705406 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-071d4a98-8e2c-40c8-9d92-d5b3344549ec tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:07.743146 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-071d4a98-8e2c-40c8-9d92-d5b3344549ec tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054312 Jan 19 16:06:07.744219 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 372/696] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:06:07 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:06:08.757551 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e98d90c9-abe8-41f0-aa7e-d29038e3f4ca tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:08.758384 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-e98d90c9-abe8-41f0-aa7e-d29038e3f4ca tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:08.765182 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e98d90c9-abe8-41f0-aa7e-d29038e3f4ca tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:08.765628 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e98d90c9-abe8-41f0-aa7e-d29038e3f4ca tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:08.766575 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e98d90c9-abe8-41f0-aa7e-d29038e3f4ca tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:08.767037 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e98d90c9-abe8-41f0-aa7e-d29038e3f4ca tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:08.799113 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e98d90c9-abe8-41f0-aa7e-d29038e3f4ca tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045423 Jan 19 16:06:08.799717 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 325/697] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:06:08 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:06:09.811641 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-46456c6d-e2ec-4095-a0d2-b8776e7dbee6 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:09.812630 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-46456c6d-e2ec-4095-a0d2-b8776e7dbee6 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:09.820023 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-46456c6d-e2ec-4095-a0d2-b8776e7dbee6 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:09.820460 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-46456c6d-e2ec-4095-a0d2-b8776e7dbee6 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:09.821259 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-46456c6d-e2ec-4095-a0d2-b8776e7dbee6 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:09.821687 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-46456c6d-e2ec-4095-a0d2-b8776e7dbee6 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:09.855942 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-46456c6d-e2ec-4095-a0d2-b8776e7dbee6 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048463 Jan 19 16:06:09.856545 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 373/698] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:06:09 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:06:10.868546 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-cd63aac5-6ec5-47b0-8773-b836ae56b667 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:10.869489 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-cd63aac5-6ec5-47b0-8773-b836ae56b667 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:10.879185 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cd63aac5-6ec5-47b0-8773-b836ae56b667 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:10.879963 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cd63aac5-6ec5-47b0-8773-b836ae56b667 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:10.881307 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cd63aac5-6ec5-47b0-8773-b836ae56b667 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:10.882078 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cd63aac5-6ec5-47b0-8773-b836ae56b667 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:10.915850 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-cd63aac5-6ec5-47b0-8773-b836ae56b667 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051104 Jan 19 16:06:10.916431 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 326/699] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:06:10 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:06:11.928481 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c570c722-557a-48a5-b5aa-f680840f620c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:11.929387 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c570c722-557a-48a5-b5aa-f680840f620c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:11.935856 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c570c722-557a-48a5-b5aa-f680840f620c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:11.936297 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c570c722-557a-48a5-b5aa-f680840f620c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:11.937072 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c570c722-557a-48a5-b5aa-f680840f620c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:11.937501 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c570c722-557a-48a5-b5aa-f680840f620c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:11.967255 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c570c722-557a-48a5-b5aa-f680840f620c tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042733 Jan 19 16:06:11.967821 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 374/700] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:06:11 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:06:12.981247 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ab87f9f1-9b91-42ca-bb8c-65492c22249d tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:12.982681 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-ab87f9f1-9b91-42ca-bb8c-65492c22249d tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:12.991429 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ab87f9f1-9b91-42ca-bb8c-65492c22249d tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:12.991979 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ab87f9f1-9b91-42ca-bb8c-65492c22249d tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:12.994206 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ab87f9f1-9b91-42ca-bb8c-65492c22249d tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:12.995295 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ab87f9f1-9b91-42ca-bb8c-65492c22249d tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:13.054559 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-ab87f9f1-9b91-42ca-bb8c-65492c22249d tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077355 Jan 19 16:06:13.056238 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 327/701] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:06:12 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:06:14.070157 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f45e6fdb-be7a-4baa-a28b-7bff468b0ad2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:14.071787 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f45e6fdb-be7a-4baa-a28b-7bff468b0ad2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:14.084671 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f45e6fdb-be7a-4baa-a28b-7bff468b0ad2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:14.086690 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f45e6fdb-be7a-4baa-a28b-7bff468b0ad2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:14.088411 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f45e6fdb-be7a-4baa-a28b-7bff468b0ad2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:14.089308 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f45e6fdb-be7a-4baa-a28b-7bff468b0ad2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:14.156992 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f45e6fdb-be7a-4baa-a28b-7bff468b0ad2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092532 Jan 19 16:06:14.164190 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 375/702] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:06:14 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:06:15.152450 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-3cf5152a-5d05-41e4-8730-a4e9a1de6d5d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "afd1dc93-13f1-4895-8065-1edd8b2a11d0"}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:06:15.154348 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-3cf5152a-5d05-41e4-8730-a4e9a1de6d5d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:15.162636 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3cf5152a-5d05-41e4-8730-a4e9a1de6d5d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:15.163112 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3cf5152a-5d05-41e4-8730-a4e9a1de6d5d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:15.163939 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3cf5152a-5d05-41e4-8730-a4e9a1de6d5d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:15.164379 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3cf5152a-5d05-41e4-8730-a4e9a1de6d5d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:15.269806 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f0d09ade-fadd-4fed-ba7f-fa1f7abbb501 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d10fafca-66f9-41c9-8847-2c1293426e03"}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:06:15.270878 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f0d09ade-fadd-4fed-ba7f-fa1f7abbb501 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:15.277790 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f0d09ade-fadd-4fed-ba7f-fa1f7abbb501 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:15.278236 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f0d09ade-fadd-4fed-ba7f-fa1f7abbb501 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:15.279078 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f0d09ade-fadd-4fed-ba7f-fa1f7abbb501 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:15.279518 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f0d09ade-fadd-4fed-ba7f-fa1f7abbb501 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:16.541429 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-3cf5152a-5d05-41e4-8730-a4e9a1de6d5d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "POST /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.393371 Jan 19 16:06:16.543495 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 328/703] 10.222.0.58 () {60 vars in 1322 bytes} [Wed Jan 19 16:06:15 2022] POST /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3/os-volume_attachments => generated 194 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:06:16.550617 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-1a740593-a68f-4a2a-99fc-675e6b2cd249 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:06:16.551675 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-1a740593-a68f-4a2a-99fc-675e6b2cd249 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:16.560746 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1a740593-a68f-4a2a-99fc-675e6b2cd249 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:16.561717 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1a740593-a68f-4a2a-99fc-675e6b2cd249 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:16.562917 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1a740593-a68f-4a2a-99fc-675e6b2cd249 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:16.563584 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1a740593-a68f-4a2a-99fc-675e6b2cd249 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:16.592810 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.objects.instance [None req-1a740593-a68f-4a2a-99fc-675e6b2cd249 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lazy-loading 'flavor' on Instance uuid 02ba601a-94e7-486f-9d1b-7418ae534f4f {{(pid=128875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:06:16.660235 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f0d09ade-fadd-4fed-ba7f-fa1f7abbb501 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.394663 Jan 19 16:06:16.675905 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 376/704] 10.222.0.58 () {60 vars in 1322 bytes} [Wed Jan 19 16:06:15 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/os-volume_attachments => generated 194 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:06:17.402545 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-1a740593-a68f-4a2a-99fc-675e6b2cd249 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 202 len: 0 microversion: 2.20 time: 0.856616 Jan 19 16:06:17.404309 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 329/705] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:06:16 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 0 bytes in 860 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:06:17.413855 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-64375b94-70c6-4093-89c9-24212ebf6688 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:17.414555 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-64375b94-70c6-4093-89c9-24212ebf6688 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:17.421670 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-64375b94-70c6-4093-89c9-24212ebf6688 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:17.422198 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-64375b94-70c6-4093-89c9-24212ebf6688 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:17.423102 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-64375b94-70c6-4093-89c9-24212ebf6688 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:17.423741 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-64375b94-70c6-4093-89c9-24212ebf6688 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:17.634413 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-64375b94-70c6-4093-89c9-24212ebf6688 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:17.643648 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-64375b94-70c6-4093-89c9-24212ebf6688 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:17.645478 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-64375b94-70c6-4093-89c9-24212ebf6688 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:17.646942 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-64375b94-70c6-4093-89c9-24212ebf6688 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1720 microversion: 2.20 time: 0.237320 Jan 19 16:06:17.647536 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 377/706] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:17 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1720 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:06:18.151874 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-727f329c-08eb-4c33-8a5a-91f7359fd63e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:18.154048 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-727f329c-08eb-4c33-8a5a-91f7359fd63e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:18.162617 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-727f329c-08eb-4c33-8a5a-91f7359fd63e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:18.163537 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-727f329c-08eb-4c33-8a5a-91f7359fd63e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:18.164455 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-727f329c-08eb-4c33-8a5a-91f7359fd63e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:18.165462 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-727f329c-08eb-4c33-8a5a-91f7359fd63e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:18.204791 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-727f329c-08eb-4c33-8a5a-91f7359fd63e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Going to try to terminate instance {{(pid=128875) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:06:18.592796 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-727f329c-08eb-4c33-8a5a-91f7359fd63e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 204 len: 0 microversion: 2.1 time: 0.445771 Jan 19 16:06:18.593644 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 330/707] 10.222.0.58 () {58 vars in 1238 bytes} [Wed Jan 19 16:06:18 2022] DELETE /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:06:18.603557 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-1d0e750e-b715-482f-b92d-40dd14fbec4d tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:18.604534 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-1d0e750e-b715-482f-b92d-40dd14fbec4d tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:18.613847 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1d0e750e-b715-482f-b92d-40dd14fbec4d tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:18.614383 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1d0e750e-b715-482f-b92d-40dd14fbec4d tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:18.615319 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1d0e750e-b715-482f-b92d-40dd14fbec4d tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:18.615821 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1d0e750e-b715-482f-b92d-40dd14fbec4d tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:18.673586 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-dff86522-d70e-4d67-955e-266a223a111a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:18.673586 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-dff86522-d70e-4d67-955e-266a223a111a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:18.700942 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-dff86522-d70e-4d67-955e-266a223a111a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:18.701843 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-dff86522-d70e-4d67-955e-266a223a111a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:18.718736 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-dff86522-d70e-4d67-955e-266a223a111a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:18.720070 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-dff86522-d70e-4d67-955e-266a223a111a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:18.890130 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-1d0e750e-b715-482f-b92d-40dd14fbec4d tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:18.900086 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-1d0e750e-b715-482f-b92d-40dd14fbec4d tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1507 microversion: 2.1 time: 0.300659 Jan 19 16:06:18.902064 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 378/708] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:18 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1507 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:18.918935 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3c382a11-f711-482d-90f7-7ba40e08bd89 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:18.919608 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3c382a11-f711-482d-90f7-7ba40e08bd89 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:18.937495 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3c382a11-f711-482d-90f7-7ba40e08bd89 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:18.938098 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3c382a11-f711-482d-90f7-7ba40e08bd89 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:18.939607 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3c382a11-f711-482d-90f7-7ba40e08bd89 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:18.940156 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3c382a11-f711-482d-90f7-7ba40e08bd89 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:19.024624 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-dff86522-d70e-4d67-955e-266a223a111a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:19.035241 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-dff86522-d70e-4d67-955e-266a223a111a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:19.039454 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-dff86522-d70e-4d67-955e-266a223a111a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:19.041795 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-dff86522-d70e-4d67-955e-266a223a111a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1720 microversion: 2.20 time: 0.378151 Jan 19 16:06:19.042378 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 331/709] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:18 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1720 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:06:19.046279 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.objects.instance [None req-3c382a11-f711-482d-90f7-7ba40e08bd89 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lazy-loading 'services' on Instance uuid 51253e38-0958-4960-8f9e-0bfa89782bd9 {{(pid=128876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:06:19.289331 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3c382a11-f711-482d-90f7-7ba40e08bd89 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "DELETE /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9/os-volume_attachments/8f03cd52-56fc-49ce-975d-07f77fd216f5" status: 202 len: 0 microversion: 2.1 time: 0.381377 Jan 19 16:06:19.289979 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 379/710] 10.222.0.58 () {58 vars in 1415 bytes} [Wed Jan 19 16:06:18 2022] DELETE /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9/os-volume_attachments/8f03cd52-56fc-49ce-975d-07f77fd216f5 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:06:19.922115 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f1f13df9-a659-483e-bb1f-6f10822ead57 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:19.922115 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-f1f13df9-a659-483e-bb1f-6f10822ead57 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:19.929735 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f1f13df9-a659-483e-bb1f-6f10822ead57 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:19.930483 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f1f13df9-a659-483e-bb1f-6f10822ead57 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:19.931308 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f1f13df9-a659-483e-bb1f-6f10822ead57 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:19.931734 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f1f13df9-a659-483e-bb1f-6f10822ead57 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:20.064776 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c3ec167b-31cd-4bc8-aa18-4d8a5003b956 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:20.074904 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c3ec167b-31cd-4bc8-aa18-4d8a5003b956 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:20.099700 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c3ec167b-31cd-4bc8-aa18-4d8a5003b956 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:20.100493 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c3ec167b-31cd-4bc8-aa18-4d8a5003b956 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:20.101580 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c3ec167b-31cd-4bc8-aa18-4d8a5003b956 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:20.102230 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c3ec167b-31cd-4bc8-aa18-4d8a5003b956 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:20.135649 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-f1f13df9-a659-483e-bb1f-6f10822ead57 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:20.151378 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f1f13df9-a659-483e-bb1f-6f10822ead57 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1507 microversion: 2.1 time: 0.234184 Jan 19 16:06:20.152076 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 332/711] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:19 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1507 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:20.243414 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c3ec167b-31cd-4bc8-aa18-4d8a5003b956 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:20.251554 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c3ec167b-31cd-4bc8-aa18-4d8a5003b956 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:20.253055 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c3ec167b-31cd-4bc8-aa18-4d8a5003b956 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:20.254220 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c3ec167b-31cd-4bc8-aa18-4d8a5003b956 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1720 microversion: 2.20 time: 0.196633 Jan 19 16:06:20.255024 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 380/712] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:20 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1720 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:06:21.170626 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-9a8d0465-e7a0-45c3-9d05-388d6e2683cb tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:21.171869 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-9a8d0465-e7a0-45c3-9d05-388d6e2683cb tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:21.183813 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9a8d0465-e7a0-45c3-9d05-388d6e2683cb tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:21.184561 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9a8d0465-e7a0-45c3-9d05-388d6e2683cb tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:21.192961 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9a8d0465-e7a0-45c3-9d05-388d6e2683cb tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:21.193930 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9a8d0465-e7a0-45c3-9d05-388d6e2683cb tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:21.296256 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e6a1c460-63da-478c-b967-f8fc45521c18 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:21.297620 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-e6a1c460-63da-478c-b967-f8fc45521c18 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:21.314091 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e6a1c460-63da-478c-b967-f8fc45521c18 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:21.315606 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e6a1c460-63da-478c-b967-f8fc45521c18 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:21.316480 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e6a1c460-63da-478c-b967-f8fc45521c18 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:21.316949 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e6a1c460-63da-478c-b967-f8fc45521c18 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:21.426652 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-9a8d0465-e7a0-45c3-9d05-388d6e2683cb tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:21.438720 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-9a8d0465-e7a0-45c3-9d05-388d6e2683cb tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1507 microversion: 2.1 time: 0.272571 Jan 19 16:06:21.450674 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 333/713] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:21 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1507 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:21.561380 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e6a1c460-63da-478c-b967-f8fc45521c18 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:21.571079 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e6a1c460-63da-478c-b967-f8fc45521c18 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:21.572865 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e6a1c460-63da-478c-b967-f8fc45521c18 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:21.574186 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e6a1c460-63da-478c-b967-f8fc45521c18 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1720 microversion: 2.20 time: 0.303862 Jan 19 16:06:21.575025 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 381/714] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:21 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1720 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:06:22.458570 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-75522a4a-2596-4513-ba63-cdfd806be35b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:22.459564 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-75522a4a-2596-4513-ba63-cdfd806be35b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:22.472428 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-75522a4a-2596-4513-ba63-cdfd806be35b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:22.473619 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-75522a4a-2596-4513-ba63-cdfd806be35b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:22.475211 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-75522a4a-2596-4513-ba63-cdfd806be35b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:22.476195 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-75522a4a-2596-4513-ba63-cdfd806be35b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:22.615042 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-2574e4af-6b4b-4a8c-a69f-21f360968695 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:22.617200 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-2574e4af-6b4b-4a8c-a69f-21f360968695 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:22.645297 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2574e4af-6b4b-4a8c-a69f-21f360968695 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:22.646615 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2574e4af-6b4b-4a8c-a69f-21f360968695 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:22.648838 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2574e4af-6b4b-4a8c-a69f-21f360968695 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:22.650065 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2574e4af-6b4b-4a8c-a69f-21f360968695 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:22.920976 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-2574e4af-6b4b-4a8c-a69f-21f360968695 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:22.937257 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-2574e4af-6b4b-4a8c-a69f-21f360968695 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:22.941844 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-2574e4af-6b4b-4a8c-a69f-21f360968695 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:22.943642 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-2574e4af-6b4b-4a8c-a69f-21f360968695 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1720 microversion: 2.20 time: 0.342617 Jan 19 16:06:22.944580 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 382/715] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:22 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1720 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:06:23.133855 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-75522a4a-2596-4513-ba63-cdfd806be35b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:23.145941 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-75522a4a-2596-4513-ba63-cdfd806be35b tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1507 microversion: 2.1 time: 0.692272 Jan 19 16:06:23.155453 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 334/716] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:22 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1507 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:23.924511 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-55c99000-a611-48ce-8fd4-414bf2fd8312 req-de6370ae-437f-46b6-a49f-43bbcae42e31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eafd976-e41c-44be-8b8e-358dd69f371d", "name": "network-vif-deleted", "tag": "249b2651-5483-475a-b81d-a745b21a7e43"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:06:23.928722 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:06:23.928722 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:06:23.946350 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-55c99000-a611-48ce-8fd4-414bf2fd8312 req-de6370ae-437f-46b6-a49f-43bbcae42e31 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:23.951532 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-55c99000-a611-48ce-8fd4-414bf2fd8312 req-de6370ae-437f-46b6-a49f-43bbcae42e31 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:23.974537 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-55c99000-a611-48ce-8fd4-414bf2fd8312 req-de6370ae-437f-46b6-a49f-43bbcae42e31 service nova] Creating event network-vif-deleted:249b2651-5483-475a-b81d-a745b21a7e43 for instance 4eafd976-e41c-44be-8b8e-358dd69f371d on hv-cinder-82002 Jan 19 16:06:23.985929 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6195abc4-2a73-4958-86f1-aad8bf4ddbc5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:23.986887 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-6195abc4-2a73-4958-86f1-aad8bf4ddbc5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:23.987662 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-55c99000-a611-48ce-8fd4-414bf2fd8312 req-de6370ae-437f-46b6-a49f-43bbcae42e31 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069472 Jan 19 16:06:23.996437 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 383/717] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:06:24.034880 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6195abc4-2a73-4958-86f1-aad8bf4ddbc5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:24.038418 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6195abc4-2a73-4958-86f1-aad8bf4ddbc5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:24.042126 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6195abc4-2a73-4958-86f1-aad8bf4ddbc5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:24.048428 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6195abc4-2a73-4958-86f1-aad8bf4ddbc5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:24.168313 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-aeb97e19-52d8-4be3-9164-4c0cc2688f1e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:24.173970 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-aeb97e19-52d8-4be3-9164-4c0cc2688f1e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:24.197907 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-aeb97e19-52d8-4be3-9164-4c0cc2688f1e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:24.198754 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-aeb97e19-52d8-4be3-9164-4c0cc2688f1e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:24.200180 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-aeb97e19-52d8-4be3-9164-4c0cc2688f1e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:24.201170 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-aeb97e19-52d8-4be3-9164-4c0cc2688f1e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:24.340158 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-aeb97e19-52d8-4be3-9164-4c0cc2688f1e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:24.395365 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-aeb97e19-52d8-4be3-9164-4c0cc2688f1e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1293 microversion: 2.1 time: 0.213950 Jan 19 16:06:24.395365 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 384/718] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:24 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1293 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:24.417463 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6195abc4-2a73-4958-86f1-aad8bf4ddbc5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:24.440812 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6195abc4-2a73-4958-86f1-aad8bf4ddbc5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:24.445718 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6195abc4-2a73-4958-86f1-aad8bf4ddbc5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:24.452806 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6195abc4-2a73-4958-86f1-aad8bf4ddbc5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1720 microversion: 2.20 time: 0.474766 Jan 19 16:06:24.457409 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 335/719] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:23 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1720 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:06:25.410286 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-1b15b022-2aa2-4d77-aa92-b6eb9c183f9e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:25.411765 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-1b15b022-2aa2-4d77-aa92-b6eb9c183f9e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:25.425418 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1b15b022-2aa2-4d77-aa92-b6eb9c183f9e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:25.426183 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1b15b022-2aa2-4d77-aa92-b6eb9c183f9e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:25.427302 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1b15b022-2aa2-4d77-aa92-b6eb9c183f9e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:25.430547 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1b15b022-2aa2-4d77-aa92-b6eb9c183f9e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:25.476181 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ca6c9d6c-d484-448f-875d-573ab9f11a91 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:25.477500 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-ca6c9d6c-d484-448f-875d-573ab9f11a91 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:25.489451 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ca6c9d6c-d484-448f-875d-573ab9f11a91 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:25.490152 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ca6c9d6c-d484-448f-875d-573ab9f11a91 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:25.492013 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ca6c9d6c-d484-448f-875d-573ab9f11a91 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:25.492675 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ca6c9d6c-d484-448f-875d-573ab9f11a91 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:25.635514 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1b15b022-2aa2-4d77-aa92-b6eb9c183f9e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:25.636763 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1b15b022-2aa2-4d77-aa92-b6eb9c183f9e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:25.637486 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.objects.instance [None req-1b15b022-2aa2-4d77-aa92-b6eb9c183f9e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lazy-loading 'fault' on Instance uuid 4eafd976-e41c-44be-8b8e-358dd69f371d {{(pid=128876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:06:25.755392 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-1b15b022-2aa2-4d77-aa92-b6eb9c183f9e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:25.770877 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-1b15b022-2aa2-4d77-aa92-b6eb9c183f9e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 200 len: 1312 microversion: 2.1 time: 0.364796 Jan 19 16:06:25.778548 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 385/720] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:25 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 1312 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:25.822436 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ca6c9d6c-d484-448f-875d-573ab9f11a91 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:25.852455 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ca6c9d6c-d484-448f-875d-573ab9f11a91 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:25.856834 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ca6c9d6c-d484-448f-875d-573ab9f11a91 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:25.861372 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-ca6c9d6c-d484-448f-875d-573ab9f11a91 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1720 microversion: 2.20 time: 0.389121 Jan 19 16:06:25.881225 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 336/721] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:25 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1720 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:06:26.798632 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d3a67581-cc90-4dc2-9b14-5a874a1ba0df tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:26.799446 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-d3a67581-cc90-4dc2-9b14-5a874a1ba0df tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 4eafd976-e41c-44be-8b8e-358dd69f371d] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:26.807773 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d3a67581-cc90-4dc2-9b14-5a874a1ba0df tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:26.808209 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d3a67581-cc90-4dc2-9b14-5a874a1ba0df tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:26.809248 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d3a67581-cc90-4dc2-9b14-5a874a1ba0df tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:26.809676 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d3a67581-cc90-4dc2-9b14-5a874a1ba0df tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:26.829595 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.wsgi [None req-d3a67581-cc90-4dc2-9b14-5a874a1ba0df tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] HTTP exception thrown: Instance 4eafd976-e41c-44be-8b8e-358dd69f371d could not be found. Jan 19 16:06:26.830273 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d3a67581-cc90-4dc2-9b14-5a874a1ba0df tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Returning 404 to user: Instance 4eafd976-e41c-44be-8b8e-358dd69f371d could not be found. {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:06:26.831323 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-d3a67581-cc90-4dc2-9b14-5a874a1ba0df tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d" status: 404 len: 111 microversion: 2.1 time: 0.037401 Jan 19 16:06:26.836569 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 386/722] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:26 2022] GET /compute/v2.1/servers/4eafd976-e41c-44be-8b8e-358dd69f371d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:06:26.846119 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-36b5bed4-8495-4bfc-a2a3-0da98f1296d6 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:26.846707 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-36b5bed4-8495-4bfc-a2a3-0da98f1296d6 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:26.852145 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c5e49a13-75de-4bb8-b674-24c122770807 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:26.854561 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c5e49a13-75de-4bb8-b674-24c122770807 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:26.854762 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-36b5bed4-8495-4bfc-a2a3-0da98f1296d6 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:26.854762 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-36b5bed4-8495-4bfc-a2a3-0da98f1296d6 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:26.854762 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-36b5bed4-8495-4bfc-a2a3-0da98f1296d6 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:26.855310 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-36b5bed4-8495-4bfc-a2a3-0da98f1296d6 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:26.859293 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c5e49a13-75de-4bb8-b674-24c122770807 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:26.859795 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c5e49a13-75de-4bb8-b674-24c122770807 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:26.860593 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c5e49a13-75de-4bb8-b674-24c122770807 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:26.861021 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c5e49a13-75de-4bb8-b674-24c122770807 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:26.897126 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-36b5bed4-8495-4bfc-a2a3-0da98f1296d6 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Going to try to terminate instance {{(pid=128875) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:06:26.997749 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.objects.instance [None req-c5e49a13-75de-4bb8-b674-24c122770807 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lazy-loading 'services' on Instance uuid d6452b53-f8fd-4bcf-853a-b6cba80219d3 {{(pid=128876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:06:27.293819 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-36b5bed4-8495-4bfc-a2a3-0da98f1296d6 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "DELETE /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 204 len: 0 microversion: 2.1 time: 0.457299 Jan 19 16:06:27.298447 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 337/723] 10.222.0.58 () {58 vars in 1238 bytes} [Wed Jan 19 16:06:26 2022] DELETE /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:06:27.309538 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c5e49a13-75de-4bb8-b674-24c122770807 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3/os-volume_attachments/afd1dc93-13f1-4895-8065-1edd8b2a11d0" status: 202 len: 0 microversion: 2.1 time: 0.460282 Jan 19 16:06:27.310146 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 387/724] 10.222.0.58 () {58 vars in 1415 bytes} [Wed Jan 19 16:06:26 2022] DELETE /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3/os-volume_attachments/afd1dc93-13f1-4895-8065-1edd8b2a11d0 => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:06:27.323995 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ca41a350-7b12-4938-af73-ba658aabf5c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:27.324712 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-ca41a350-7b12-4938-af73-ba658aabf5c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:27.331377 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f046b5b2-48ac-41ee-bb7e-2d6e4ea8e403 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:27.332070 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f046b5b2-48ac-41ee-bb7e-2d6e4ea8e403 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:27.339592 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ca41a350-7b12-4938-af73-ba658aabf5c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:27.340589 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f046b5b2-48ac-41ee-bb7e-2d6e4ea8e403 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:27.341081 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f046b5b2-48ac-41ee-bb7e-2d6e4ea8e403 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:27.341396 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ca41a350-7b12-4938-af73-ba658aabf5c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:27.342156 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f046b5b2-48ac-41ee-bb7e-2d6e4ea8e403 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:27.342577 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ca41a350-7b12-4938-af73-ba658aabf5c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:27.342895 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f046b5b2-48ac-41ee-bb7e-2d6e4ea8e403 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:27.343039 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ca41a350-7b12-4938-af73-ba658aabf5c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:27.529368 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f046b5b2-48ac-41ee-bb7e-2d6e4ea8e403 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:27.540144 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f046b5b2-48ac-41ee-bb7e-2d6e4ea8e403 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1519 microversion: 2.1 time: 0.212895 Jan 19 16:06:27.541237 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 388/725] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:27 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1519 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:27.547486 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-0abbfe76-06c2-479b-9ff6-596b913d776a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:27.548689 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-0abbfe76-06c2-479b-9ff6-596b913d776a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:27.556366 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0abbfe76-06c2-479b-9ff6-596b913d776a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:27.556988 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0abbfe76-06c2-479b-9ff6-596b913d776a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:27.557211 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ca41a350-7b12-4938-af73-ba658aabf5c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:27.558013 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0abbfe76-06c2-479b-9ff6-596b913d776a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:27.558563 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0abbfe76-06c2-479b-9ff6-596b913d776a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:27.571635 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ca41a350-7b12-4938-af73-ba658aabf5c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:27.573152 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ca41a350-7b12-4938-af73-ba658aabf5c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:27.574627 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-ca41a350-7b12-4938-af73-ba658aabf5c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1720 microversion: 2.20 time: 0.270652 Jan 19 16:06:27.575938 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 338/726] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:27 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1720 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:06:27.605764 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-0abbfe76-06c2-479b-9ff6-596b913d776a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063110 Jan 19 16:06:27.611161 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 389/727] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:06:27 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:06:28.561930 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-2d60c29d-3264-42b3-8a92-ff49d8c3f07f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:28.562664 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-2d60c29d-3264-42b3-8a92-ff49d8c3f07f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:28.570342 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2d60c29d-3264-42b3-8a92-ff49d8c3f07f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:28.579425 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2d60c29d-3264-42b3-8a92-ff49d8c3f07f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:28.580693 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2d60c29d-3264-42b3-8a92-ff49d8c3f07f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:28.581407 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2d60c29d-3264-42b3-8a92-ff49d8c3f07f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:28.598586 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-4f9c106c-3472-4ac2-b2b4-3da4e8b11501 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:28.599212 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-4f9c106c-3472-4ac2-b2b4-3da4e8b11501 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:28.606451 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4f9c106c-3472-4ac2-b2b4-3da4e8b11501 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:28.606906 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4f9c106c-3472-4ac2-b2b4-3da4e8b11501 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:28.609937 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4f9c106c-3472-4ac2-b2b4-3da4e8b11501 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:28.610389 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4f9c106c-3472-4ac2-b2b4-3da4e8b11501 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:28.791417 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-4f9c106c-3472-4ac2-b2b4-3da4e8b11501 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:28.798816 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-4f9c106c-3472-4ac2-b2b4-3da4e8b11501 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:28.800517 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-4f9c106c-3472-4ac2-b2b4-3da4e8b11501 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:28.801722 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-4f9c106c-3472-4ac2-b2b4-3da4e8b11501 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1720 microversion: 2.20 time: 0.206989 Jan 19 16:06:28.802298 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 390/728] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:28 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1720 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:06:28.805972 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-2d60c29d-3264-42b3-8a92-ff49d8c3f07f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:28.815517 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-2d60c29d-3264-42b3-8a92-ff49d8c3f07f tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1519 microversion: 2.1 time: 0.258155 Jan 19 16:06:28.816697 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 339/729] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:28 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1519 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:28.821483 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c521516f-75f1-4d3d-bfd7-7555200ea2b1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:28.822462 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c521516f-75f1-4d3d-bfd7-7555200ea2b1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:28.829689 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c521516f-75f1-4d3d-bfd7-7555200ea2b1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:28.830219 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c521516f-75f1-4d3d-bfd7-7555200ea2b1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:28.831084 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c521516f-75f1-4d3d-bfd7-7555200ea2b1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:28.831527 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c521516f-75f1-4d3d-bfd7-7555200ea2b1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:28.897999 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c521516f-75f1-4d3d-bfd7-7555200ea2b1 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079782 Jan 19 16:06:28.899023 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 391/730] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:06:28 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:06:29.820955 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e3729244-ab3b-4543-9902-dd55b0d4488e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:29.821706 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-e3729244-ab3b-4543-9902-dd55b0d4488e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:29.829549 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e3729244-ab3b-4543-9902-dd55b0d4488e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:29.829938 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e3729244-ab3b-4543-9902-dd55b0d4488e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:29.830759 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e3729244-ab3b-4543-9902-dd55b0d4488e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:29.831214 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e3729244-ab3b-4543-9902-dd55b0d4488e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:29.845974 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-950a0062-134e-4b09-941e-bbbf8749811e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:29.846698 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-950a0062-134e-4b09-941e-bbbf8749811e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:29.856103 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-950a0062-134e-4b09-941e-bbbf8749811e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:29.856781 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-950a0062-134e-4b09-941e-bbbf8749811e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:29.857554 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-950a0062-134e-4b09-941e-bbbf8749811e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:29.857992 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-950a0062-134e-4b09-941e-bbbf8749811e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:30.025234 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e3729244-ab3b-4543-9902-dd55b0d4488e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:30.034169 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e3729244-ab3b-4543-9902-dd55b0d4488e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:30.035737 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e3729244-ab3b-4543-9902-dd55b0d4488e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:30.036914 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e3729244-ab3b-4543-9902-dd55b0d4488e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1720 microversion: 2.20 time: 0.220050 Jan 19 16:06:30.037487 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 340/731] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:29 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1720 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:06:30.042044 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d47ee302-1450-4458-8bd4-f99f0d9c0aa9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:30.043035 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d47ee302-1450-4458-8bd4-f99f0d9c0aa9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:30.055413 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-950a0062-134e-4b09-941e-bbbf8749811e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:30.055613 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d47ee302-1450-4458-8bd4-f99f0d9c0aa9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:30.055613 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d47ee302-1450-4458-8bd4-f99f0d9c0aa9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:30.055613 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d47ee302-1450-4458-8bd4-f99f0d9c0aa9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:30.055613 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d47ee302-1450-4458-8bd4-f99f0d9c0aa9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:30.059421 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-950a0062-134e-4b09-941e-bbbf8749811e tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1519 microversion: 2.1 time: 0.218253 Jan 19 16:06:30.060023 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 392/732] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:29 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1519 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:30.086703 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d47ee302-1450-4458-8bd4-f99f0d9c0aa9 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048152 Jan 19 16:06:30.087338 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 341/733] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:06:30 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:06:31.059149 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8fb9b8de-f988-47ad-a65c-899ad47733cd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:31.060325 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-8fb9b8de-f988-47ad-a65c-899ad47733cd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:31.067473 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8fb9b8de-f988-47ad-a65c-899ad47733cd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:31.067926 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8fb9b8de-f988-47ad-a65c-899ad47733cd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:31.068749 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8fb9b8de-f988-47ad-a65c-899ad47733cd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:31.069176 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8fb9b8de-f988-47ad-a65c-899ad47733cd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:31.085642 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f323329d-651e-463e-865f-8c0a81646f26 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:31.087761 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-f323329d-651e-463e-865f-8c0a81646f26 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:31.098675 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f323329d-651e-463e-865f-8c0a81646f26 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:31.098675 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f323329d-651e-463e-865f-8c0a81646f26 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:31.099399 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f323329d-651e-463e-865f-8c0a81646f26 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:31.099603 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f323329d-651e-463e-865f-8c0a81646f26 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:31.243896 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8fb9b8de-f988-47ad-a65c-899ad47733cd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:31.267843 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8fb9b8de-f988-47ad-a65c-899ad47733cd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:31.271270 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8fb9b8de-f988-47ad-a65c-899ad47733cd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:31.284618 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-8fb9b8de-f988-47ad-a65c-899ad47733cd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1720 microversion: 2.20 time: 0.230569 Jan 19 16:06:31.284618 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 393/734] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:31 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1720 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:06:31.294263 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-4cd3d5ae-d0c8-43c4-8352-631b1669c5a6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:31.299630 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-4cd3d5ae-d0c8-43c4-8352-631b1669c5a6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:31.303819 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-f323329d-651e-463e-865f-8c0a81646f26 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:31.312787 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4cd3d5ae-d0c8-43c4-8352-631b1669c5a6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:31.312787 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4cd3d5ae-d0c8-43c4-8352-631b1669c5a6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:31.312787 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4cd3d5ae-d0c8-43c4-8352-631b1669c5a6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:31.313025 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f323329d-651e-463e-865f-8c0a81646f26 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1519 microversion: 2.1 time: 0.237533 Jan 19 16:06:31.313108 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 342/735] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:31 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1519 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:31.313300 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4cd3d5ae-d0c8-43c4-8352-631b1669c5a6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:31.352597 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-4cd3d5ae-d0c8-43c4-8352-631b1669c5a6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068016 Jan 19 16:06:31.353366 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 394/736] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:06:31 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:06:32.300586 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-219baf03-5aea-4c81-b4fe-fb4e474ae826 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:32.301184 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-219baf03-5aea-4c81-b4fe-fb4e474ae826 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:32.308344 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-219baf03-5aea-4c81-b4fe-fb4e474ae826 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:32.308791 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-219baf03-5aea-4c81-b4fe-fb4e474ae826 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:32.309582 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-219baf03-5aea-4c81-b4fe-fb4e474ae826 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:32.310010 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-219baf03-5aea-4c81-b4fe-fb4e474ae826 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:32.332608 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-42369ca0-5bab-4404-af0c-44ff8e6d5f23 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:32.333210 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-42369ca0-5bab-4404-af0c-44ff8e6d5f23 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:32.339867 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-42369ca0-5bab-4404-af0c-44ff8e6d5f23 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:32.340307 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-42369ca0-5bab-4404-af0c-44ff8e6d5f23 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:32.341094 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-42369ca0-5bab-4404-af0c-44ff8e6d5f23 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:32.341520 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-42369ca0-5bab-4404-af0c-44ff8e6d5f23 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:32.493106 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-219baf03-5aea-4c81-b4fe-fb4e474ae826 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:32.502999 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-219baf03-5aea-4c81-b4fe-fb4e474ae826 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:32.504555 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-219baf03-5aea-4c81-b4fe-fb4e474ae826 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:32.505748 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-219baf03-5aea-4c81-b4fe-fb4e474ae826 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1720 microversion: 2.20 time: 0.209019 Jan 19 16:06:32.506309 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 343/737] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:32 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1720 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:06:32.512100 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-0b8e1e9a-f9e8-4f89-ba84-59b9b7af6bd5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:32.512841 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-0b8e1e9a-f9e8-4f89-ba84-59b9b7af6bd5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:32.527256 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0b8e1e9a-f9e8-4f89-ba84-59b9b7af6bd5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:32.527256 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0b8e1e9a-f9e8-4f89-ba84-59b9b7af6bd5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:32.527256 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0b8e1e9a-f9e8-4f89-ba84-59b9b7af6bd5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:32.527256 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0b8e1e9a-f9e8-4f89-ba84-59b9b7af6bd5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:32.531969 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-42369ca0-5bab-4404-af0c-44ff8e6d5f23 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:32.541479 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-42369ca0-5bab-4404-af0c-44ff8e6d5f23 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1519 microversion: 2.1 time: 0.214041 Jan 19 16:06:32.543983 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 395/738] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:32 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1519 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:06:32.558756 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-0b8e1e9a-f9e8-4f89-ba84-59b9b7af6bd5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050852 Jan 19 16:06:32.559435 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 344/739] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:06:32 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:06:33.529898 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-128131ae-b160-4f27-8e17-3e990984f940 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:33.530584 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-128131ae-b160-4f27-8e17-3e990984f940 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:33.539377 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-128131ae-b160-4f27-8e17-3e990984f940 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:33.539936 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-128131ae-b160-4f27-8e17-3e990984f940 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:33.540823 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-128131ae-b160-4f27-8e17-3e990984f940 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:33.541331 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-128131ae-b160-4f27-8e17-3e990984f940 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:33.564783 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-0df67c76-16f8-4f6d-ab5a-81f53f69c31a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:33.566157 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-0df67c76-16f8-4f6d-ab5a-81f53f69c31a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:33.573189 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0df67c76-16f8-4f6d-ab5a-81f53f69c31a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:33.573733 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0df67c76-16f8-4f6d-ab5a-81f53f69c31a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:33.574563 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0df67c76-16f8-4f6d-ab5a-81f53f69c31a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:33.575026 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0df67c76-16f8-4f6d-ab5a-81f53f69c31a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:33.709223 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-128131ae-b160-4f27-8e17-3e990984f940 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:33.718753 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-128131ae-b160-4f27-8e17-3e990984f940 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:33.720262 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-128131ae-b160-4f27-8e17-3e990984f940 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:33.721730 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-128131ae-b160-4f27-8e17-3e990984f940 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1720 microversion: 2.20 time: 0.195774 Jan 19 16:06:33.733201 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 396/740] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:33 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1720 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:06:33.738426 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-31cd41a6-3184-4d06-b8b2-8809a21cb8fd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:33.739386 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-31cd41a6-3184-4d06-b8b2-8809a21cb8fd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:33.745890 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-31cd41a6-3184-4d06-b8b2-8809a21cb8fd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:33.746339 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-31cd41a6-3184-4d06-b8b2-8809a21cb8fd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:33.747174 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-31cd41a6-3184-4d06-b8b2-8809a21cb8fd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:33.747796 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-31cd41a6-3184-4d06-b8b2-8809a21cb8fd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:33.752700 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-0df67c76-16f8-4f6d-ab5a-81f53f69c31a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:33.762457 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-0df67c76-16f8-4f6d-ab5a-81f53f69c31a tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1519 microversion: 2.1 time: 0.201236 Jan 19 16:06:33.763138 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 345/741] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:33 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1519 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:06:33.803376 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-31cd41a6-3184-4d06-b8b2-8809a21cb8fd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068289 Jan 19 16:06:33.804034 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 397/742] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:06:33 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:06:34.339165 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e5d2af75-35cc-404e-81c5-9a2e10d1fd68 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:06:34.350870 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e5d2af75-35cc-404e-81c5-9a2e10d1fd68 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:34.351731 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e5d2af75-35cc-404e-81c5-9a2e10d1fd68 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:34.478339 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-e5d2af75-35cc-404e-81c5-9a2e10d1fd68 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Going to try to stop instance {{(pid=128875) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 19 16:06:34.729047 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e5d2af75-35cc-404e-81c5-9a2e10d1fd68 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 202 len: 0 microversion: 2.1 time: 0.397420 Jan 19 16:06:34.732607 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 346/743] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:06:34 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:06:34.742445 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-35e15904-e8de-465e-b37c-5aa1e186dd57 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:34.743485 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-35e15904-e8de-465e-b37c-5aa1e186dd57 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:34.745503 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-67cbc496-af72-4d2b-875a-63fcd57dbdf2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:34.746420 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-67cbc496-af72-4d2b-875a-63fcd57dbdf2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:34.753405 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-67cbc496-af72-4d2b-875a-63fcd57dbdf2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:34.757306 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-67cbc496-af72-4d2b-875a-63fcd57dbdf2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:34.757445 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-35e15904-e8de-465e-b37c-5aa1e186dd57 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:34.757445 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-35e15904-e8de-465e-b37c-5aa1e186dd57 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:34.757716 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-67cbc496-af72-4d2b-875a-63fcd57dbdf2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:34.757716 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-67cbc496-af72-4d2b-875a-63fcd57dbdf2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:34.757865 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-35e15904-e8de-465e-b37c-5aa1e186dd57 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:34.757865 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-35e15904-e8de-465e-b37c-5aa1e186dd57 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:34.934417 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-35e15904-e8de-465e-b37c-5aa1e186dd57 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:34.947024 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-35e15904-e8de-465e-b37c-5aa1e186dd57 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1724 microversion: 2.1 time: 0.210753 Jan 19 16:06:34.948903 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 398/744] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:34 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:34.954646 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3f8272a1-f41c-446d-8aee-5d7406f8e3a8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:34.959150 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3f8272a1-f41c-446d-8aee-5d7406f8e3a8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:34.971175 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3f8272a1-f41c-446d-8aee-5d7406f8e3a8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:34.971899 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3f8272a1-f41c-446d-8aee-5d7406f8e3a8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:34.972768 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3f8272a1-f41c-446d-8aee-5d7406f8e3a8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:34.973276 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3f8272a1-f41c-446d-8aee-5d7406f8e3a8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:35.134947 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-67cbc496-af72-4d2b-875a-63fcd57dbdf2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:35.152062 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-3f8272a1-f41c-446d-8aee-5d7406f8e3a8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:35.153462 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-67cbc496-af72-4d2b-875a-63fcd57dbdf2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:35.156668 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-67cbc496-af72-4d2b-875a-63fcd57dbdf2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:35.159114 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-67cbc496-af72-4d2b-875a-63fcd57dbdf2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1720 microversion: 2.20 time: 0.417805 Jan 19 16:06:35.162350 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 347/745] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:34 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1720 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:06:35.172125 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-168b0a48-6dfd-4e9a-9350-6b67230caeee tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:35.175153 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-168b0a48-6dfd-4e9a-9350-6b67230caeee tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:35.183260 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3f8272a1-f41c-446d-8aee-5d7406f8e3a8 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1519 microversion: 2.1 time: 0.231359 Jan 19 16:06:35.189301 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 399/746] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:34 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1519 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:35.189438 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-168b0a48-6dfd-4e9a-9350-6b67230caeee tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:35.189438 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-168b0a48-6dfd-4e9a-9350-6b67230caeee tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:35.189438 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-168b0a48-6dfd-4e9a-9350-6b67230caeee tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:35.189438 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-168b0a48-6dfd-4e9a-9350-6b67230caeee tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:35.233789 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-168b0a48-6dfd-4e9a-9350-6b67230caeee tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068732 Jan 19 16:06:35.240537 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 348/747] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:06:35 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:06:35.697805 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-c9f28d04-bf55-4572-a695-e0318d3b188f req-e75e0cc5-1f68-4045-91c7-dbf6e5d389de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "808abc0b-bb27-496f-8ce0-d536ab3d1ffb", "name": "network-vif-deleted", "tag": "25aa7996-bdd0-49c3-bda2-801229048370"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:06:35.699893 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:06:35.699893 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:06:35.703660 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-9955a958-d85d-4250-b0fd-c0940c682cbb tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:35.704207 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-9955a958-d85d-4250-b0fd-c0940c682cbb tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:35.711516 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-c9f28d04-bf55-4572-a695-e0318d3b188f req-e75e0cc5-1f68-4045-91c7-dbf6e5d389de service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:35.720174 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-c9f28d04-bf55-4572-a695-e0318d3b188f req-e75e0cc5-1f68-4045-91c7-dbf6e5d389de service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:35.720399 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9955a958-d85d-4250-b0fd-c0940c682cbb tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:35.720399 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9955a958-d85d-4250-b0fd-c0940c682cbb tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:35.720399 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9955a958-d85d-4250-b0fd-c0940c682cbb tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:35.720399 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9955a958-d85d-4250-b0fd-c0940c682cbb tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:35.727052 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-c9f28d04-bf55-4572-a695-e0318d3b188f req-e75e0cc5-1f68-4045-91c7-dbf6e5d389de service nova] Creating event network-vif-deleted:25aa7996-bdd0-49c3-bda2-801229048370 for instance 808abc0b-bb27-496f-8ce0-d536ab3d1ffb on hv-cinder-82002 Jan 19 16:06:35.735065 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-c9f28d04-bf55-4572-a695-e0318d3b188f req-e75e0cc5-1f68-4045-91c7-dbf6e5d389de service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040926 Jan 19 16:06:35.735885 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 400/748] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:06:35.768912 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-9955a958-d85d-4250-b0fd-c0940c682cbb tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Going to try to terminate instance {{(pid=128875) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:06:35.975338 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f4d344b2-6e9c-4b63-9fcc-c788b948ec5e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:35.976961 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f4d344b2-6e9c-4b63-9fcc-c788b948ec5e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:35.986523 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f4d344b2-6e9c-4b63-9fcc-c788b948ec5e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:35.987102 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f4d344b2-6e9c-4b63-9fcc-c788b948ec5e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:35.987829 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f4d344b2-6e9c-4b63-9fcc-c788b948ec5e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:35.989213 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f4d344b2-6e9c-4b63-9fcc-c788b948ec5e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:36.169313 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f4d344b2-6e9c-4b63-9fcc-c788b948ec5e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:36.179213 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f4d344b2-6e9c-4b63-9fcc-c788b948ec5e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1724 microversion: 2.1 time: 0.208487 Jan 19 16:06:36.180182 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 401/749] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:35 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:06:36.186948 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-9955a958-d85d-4250-b0fd-c0940c682cbb tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "DELETE /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9" status: 204 len: 0 microversion: 2.1 time: 0.488273 Jan 19 16:06:36.189345 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 349/750] 10.222.0.58 () {58 vars in 1238 bytes} [Wed Jan 19 16:06:35 2022] DELETE /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:06:36.194704 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5345a157-3718-48f4-b4b4-d004af75e68f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:36.195612 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5345a157-3718-48f4-b4b4-d004af75e68f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:36.201988 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5345a157-3718-48f4-b4b4-d004af75e68f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:36.203261 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5345a157-3718-48f4-b4b4-d004af75e68f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:36.204066 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5345a157-3718-48f4-b4b4-d004af75e68f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:36.204491 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5345a157-3718-48f4-b4b4-d004af75e68f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:36.211832 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-191f3744-4fad-4e91-a60b-4ad4d11234b0 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:36.212687 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-191f3744-4fad-4e91-a60b-4ad4d11234b0 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:36.219738 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-191f3744-4fad-4e91-a60b-4ad4d11234b0 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:36.220175 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-191f3744-4fad-4e91-a60b-4ad4d11234b0 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:36.221140 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-191f3744-4fad-4e91-a60b-4ad4d11234b0 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:36.221777 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-191f3744-4fad-4e91-a60b-4ad4d11234b0 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:36.359548 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5345a157-3718-48f4-b4b4-d004af75e68f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:36.369876 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5345a157-3718-48f4-b4b4-d004af75e68f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:36.371701 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5345a157-3718-48f4-b4b4-d004af75e68f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:36.372898 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5345a157-3718-48f4-b4b4-d004af75e68f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1720 microversion: 2.20 time: 0.182201 Jan 19 16:06:36.373664 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 402/751] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:36 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1720 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:06:36.378474 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-43b2b557-98f8-48f8-b41a-04b19ad84eee tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:36.379125 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-43b2b557-98f8-48f8-b41a-04b19ad84eee tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:36.393771 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-43b2b557-98f8-48f8-b41a-04b19ad84eee tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:36.395204 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-43b2b557-98f8-48f8-b41a-04b19ad84eee tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:36.396936 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-43b2b557-98f8-48f8-b41a-04b19ad84eee tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:36.397719 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-43b2b557-98f8-48f8-b41a-04b19ad84eee tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:36.402473 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-191f3744-4fad-4e91-a60b-4ad4d11234b0 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:36.410611 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-191f3744-4fad-4e91-a60b-4ad4d11234b0 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9" status: 200 len: 1512 microversion: 2.1 time: 0.211278 Jan 19 16:06:36.411921 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 350/752] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:36 2022] GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9 => generated 1512 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:36.417063 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-60f8c43f-a32b-4d19-a188-c91f9a8ae624 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:36.418393 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-60f8c43f-a32b-4d19-a188-c91f9a8ae624 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:36.424848 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-60f8c43f-a32b-4d19-a188-c91f9a8ae624 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:36.425577 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-60f8c43f-a32b-4d19-a188-c91f9a8ae624 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:36.426552 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-60f8c43f-a32b-4d19-a188-c91f9a8ae624 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:36.427242 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-60f8c43f-a32b-4d19-a188-c91f9a8ae624 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:36.443591 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-43b2b557-98f8-48f8-b41a-04b19ad84eee tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:36.444126 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-43b2b557-98f8-48f8-b41a-04b19ad84eee tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:36.444665 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.objects.instance [None req-43b2b557-98f8-48f8-b41a-04b19ad84eee tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lazy-loading 'fault' on Instance uuid 808abc0b-bb27-496f-8ce0-d536ab3d1ffb {{(pid=128876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:06:36.460556 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-60f8c43f-a32b-4d19-a188-c91f9a8ae624 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047283 Jan 19 16:06:36.461795 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 351/753] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:06:36 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:06:36.491605 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-43b2b557-98f8-48f8-b41a-04b19ad84eee tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19ed32130a254d9d84887c33e921be26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa6825475c44bf698ffb6fe7c66195b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:36.499313 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-43b2b557-98f8-48f8-b41a-04b19ad84eee tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 200 len: 1311 microversion: 2.1 time: 0.124431 Jan 19 16:06:36.500438 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 403/754] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:36 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 1311 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:37.196708 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-41aaf8f8-9d4e-46ef-b2a6-ccfbbdc50f9b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:37.197293 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-41aaf8f8-9d4e-46ef-b2a6-ccfbbdc50f9b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:37.211974 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-41aaf8f8-9d4e-46ef-b2a6-ccfbbdc50f9b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:37.212430 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-41aaf8f8-9d4e-46ef-b2a6-ccfbbdc50f9b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:37.213362 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-41aaf8f8-9d4e-46ef-b2a6-ccfbbdc50f9b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:37.213803 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-41aaf8f8-9d4e-46ef-b2a6-ccfbbdc50f9b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:37.369698 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-41aaf8f8-9d4e-46ef-b2a6-ccfbbdc50f9b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:37.379997 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-41aaf8f8-9d4e-46ef-b2a6-ccfbbdc50f9b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1724 microversion: 2.1 time: 0.187245 Jan 19 16:06:37.380609 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 352/755] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:37 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:06:37.397622 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5eadfe7d-ff30-4818-99be-62dc776b9a33 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:37.398328 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5eadfe7d-ff30-4818-99be-62dc776b9a33 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:37.405307 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5eadfe7d-ff30-4818-99be-62dc776b9a33 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:37.408853 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5eadfe7d-ff30-4818-99be-62dc776b9a33 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:37.408853 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5eadfe7d-ff30-4818-99be-62dc776b9a33 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:37.408853 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5eadfe7d-ff30-4818-99be-62dc776b9a33 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:37.439709 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-71c7a491-226a-4974-9680-1c77d054b496 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:37.440455 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-71c7a491-226a-4974-9680-1c77d054b496 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:37.446631 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-71c7a491-226a-4974-9680-1c77d054b496 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:37.447110 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-71c7a491-226a-4974-9680-1c77d054b496 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:37.447898 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-71c7a491-226a-4974-9680-1c77d054b496 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:37.448322 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-71c7a491-226a-4974-9680-1c77d054b496 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:37.569660 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5eadfe7d-ff30-4818-99be-62dc776b9a33 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:37.578712 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5eadfe7d-ff30-4818-99be-62dc776b9a33 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:37.580608 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5eadfe7d-ff30-4818-99be-62dc776b9a33 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:37.581844 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5eadfe7d-ff30-4818-99be-62dc776b9a33 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1720 microversion: 2.20 time: 0.188029 Jan 19 16:06:37.582429 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 404/756] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:37 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1720 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:06:37.587185 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-87d14108-0065-4caf-af09-8b7269073ea2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:37.587794 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-87d14108-0065-4caf-af09-8b7269073ea2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] [instance: 808abc0b-bb27-496f-8ce0-d536ab3d1ffb] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:37.597348 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-87d14108-0065-4caf-af09-8b7269073ea2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:37.597946 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-87d14108-0065-4caf-af09-8b7269073ea2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:37.599905 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-87d14108-0065-4caf-af09-8b7269073ea2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:37.605623 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-87d14108-0065-4caf-af09-8b7269073ea2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:37.618291 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.wsgi [None req-87d14108-0065-4caf-af09-8b7269073ea2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] HTTP exception thrown: Instance 808abc0b-bb27-496f-8ce0-d536ab3d1ffb could not be found. Jan 19 16:06:37.618933 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-87d14108-0065-4caf-af09-8b7269073ea2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] Returning 404 to user: Instance 808abc0b-bb27-496f-8ce0-d536ab3d1ffb could not be found. {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:06:37.620294 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-87d14108-0065-4caf-af09-8b7269073ea2 tempest-ServerRescueNegativeTestJSON-275817985 tempest-ServerRescueNegativeTestJSON-275817985-project] 10.222.0.58 "GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb" status: 404 len: 111 microversion: 2.1 time: 0.036570 Jan 19 16:06:37.621001 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 405/757] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:37 2022] GET /compute/v2.1/servers/808abc0b-bb27-496f-8ce0-d536ab3d1ffb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:06:37.647564 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-71c7a491-226a-4974-9680-1c77d054b496 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:37.656553 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-71c7a491-226a-4974-9680-1c77d054b496 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9" status: 200 len: 1512 microversion: 2.1 time: 0.220515 Jan 19 16:06:37.657173 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 353/758] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:37 2022] GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9 => generated 1512 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:06:37.886327 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-7b032169-185a-4bc9-9903-15ad0d8e6984 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:37.886829 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-7b032169-185a-4bc9-9903-15ad0d8e6984 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:37.893297 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7b032169-185a-4bc9-9903-15ad0d8e6984 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:37.893736 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7b032169-185a-4bc9-9903-15ad0d8e6984 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:37.894582 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7b032169-185a-4bc9-9903-15ad0d8e6984 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:37.895031 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7b032169-185a-4bc9-9903-15ad0d8e6984 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:37.927477 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-7b032169-185a-4bc9-9903-15ad0d8e6984 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Going to try to terminate instance {{(pid=128876) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:06:38.253584 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-7b032169-185a-4bc9-9903-15ad0d8e6984 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 204 len: 0 microversion: 2.1 time: 0.370579 Jan 19 16:06:38.254118 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 406/759] 10.222.0.58 () {58 vars in 1238 bytes} [Wed Jan 19 16:06:37 2022] DELETE /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:06:38.264024 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-77cf70bd-2961-4208-a130-145c3f0912be tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:38.264717 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-77cf70bd-2961-4208-a130-145c3f0912be tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:38.272315 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-77cf70bd-2961-4208-a130-145c3f0912be tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:38.272760 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-77cf70bd-2961-4208-a130-145c3f0912be tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:38.273742 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-77cf70bd-2961-4208-a130-145c3f0912be tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:38.274179 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-77cf70bd-2961-4208-a130-145c3f0912be tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:38.398840 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-1d89b1fd-8df6-424a-a8aa-723f3c30cd56 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:38.399934 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-1d89b1fd-8df6-424a-a8aa-723f3c30cd56 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:38.418389 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1d89b1fd-8df6-424a-a8aa-723f3c30cd56 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:38.418389 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1d89b1fd-8df6-424a-a8aa-723f3c30cd56 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:38.419195 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1d89b1fd-8df6-424a-a8aa-723f3c30cd56 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:38.419640 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1d89b1fd-8df6-424a-a8aa-723f3c30cd56 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:38.452082 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-77cf70bd-2961-4208-a130-145c3f0912be tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:38.463803 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-77cf70bd-2961-4208-a130-145c3f0912be tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1513 microversion: 2.1 time: 0.204498 Jan 19 16:06:38.464406 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 354/760] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:38 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1513 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:38.613627 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-bf4b3fe3-5c42-4fb1-ad90-2173192688a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:38.614234 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-bf4b3fe3-5c42-4fb1-ad90-2173192688a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:38.624311 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bf4b3fe3-5c42-4fb1-ad90-2173192688a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:38.624979 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bf4b3fe3-5c42-4fb1-ad90-2173192688a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:38.625976 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bf4b3fe3-5c42-4fb1-ad90-2173192688a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:38.626532 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bf4b3fe3-5c42-4fb1-ad90-2173192688a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:38.749137 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-1d89b1fd-8df6-424a-a8aa-723f3c30cd56 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:38.758087 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-1d89b1fd-8df6-424a-a8aa-723f3c30cd56 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1724 microversion: 2.1 time: 0.364524 Jan 19 16:06:38.771303 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 407/761] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:38 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1724 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:06:38.771303 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-7d81a5c7-d8a9-43f7-8766-7285a78e74b6 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:38.771303 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-7d81a5c7-d8a9-43f7-8766-7285a78e74b6 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:38.771303 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7d81a5c7-d8a9-43f7-8766-7285a78e74b6 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:38.772035 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7d81a5c7-d8a9-43f7-8766-7285a78e74b6 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:38.772554 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7d81a5c7-d8a9-43f7-8766-7285a78e74b6 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:38.773172 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7d81a5c7-d8a9-43f7-8766-7285a78e74b6 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:38.855667 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-bf4b3fe3-5c42-4fb1-ad90-2173192688a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:38.865159 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-bf4b3fe3-5c42-4fb1-ad90-2173192688a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:38.867011 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-bf4b3fe3-5c42-4fb1-ad90-2173192688a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:38.868349 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-bf4b3fe3-5c42-4fb1-ad90-2173192688a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1720 microversion: 2.20 time: 0.263107 Jan 19 16:06:38.869230 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 355/762] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:38 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1720 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:06:39.000931 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-7d81a5c7-d8a9-43f7-8766-7285a78e74b6 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:39.008508 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-7d81a5c7-d8a9-43f7-8766-7285a78e74b6 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9" status: 200 len: 1512 microversion: 2.1 time: 0.248680 Jan 19 16:06:39.009224 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 408/763] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:38 2022] GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9 => generated 1512 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:39.200907 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-b070797f-ebb1-4a1c-8efe-721e5c970215 req-4d22e00c-d135-4d13-8831-57f54f81c524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51253e38-0958-4960-8f9e-0bfa89782bd9", "name": "network-vif-deleted", "tag": "7a71b7cf-9163-4282-a5e4-03603c991693"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:06:39.202522 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:06:39.202522 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:06:39.210047 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-b070797f-ebb1-4a1c-8efe-721e5c970215 req-4d22e00c-d135-4d13-8831-57f54f81c524 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:39.210591 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-b070797f-ebb1-4a1c-8efe-721e5c970215 req-4d22e00c-d135-4d13-8831-57f54f81c524 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:39.222177 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-b070797f-ebb1-4a1c-8efe-721e5c970215 req-4d22e00c-d135-4d13-8831-57f54f81c524 service nova] Creating event network-vif-deleted:7a71b7cf-9163-4282-a5e4-03603c991693 for instance 51253e38-0958-4960-8f9e-0bfa89782bd9 on hv-cinder-82002 Jan 19 16:06:39.226962 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-b070797f-ebb1-4a1c-8efe-721e5c970215 req-4d22e00c-d135-4d13-8831-57f54f81c524 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029799 Jan 19 16:06:39.230617 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 356/764] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:06:39.481090 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-964304f6-89bd-4f1b-9226-8d7ccbf00c47 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:39.481958 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-964304f6-89bd-4f1b-9226-8d7ccbf00c47 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:39.488354 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-964304f6-89bd-4f1b-9226-8d7ccbf00c47 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:39.488806 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-964304f6-89bd-4f1b-9226-8d7ccbf00c47 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:39.489686 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-964304f6-89bd-4f1b-9226-8d7ccbf00c47 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:39.490135 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-964304f6-89bd-4f1b-9226-8d7ccbf00c47 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:39.744454 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-964304f6-89bd-4f1b-9226-8d7ccbf00c47 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:39.752838 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-964304f6-89bd-4f1b-9226-8d7ccbf00c47 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1513 microversion: 2.1 time: 0.275510 Jan 19 16:06:39.753420 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 409/765] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:39 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1513 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:39.789387 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-65be377f-cecc-4e5e-8a07-414105743ccd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:39.790085 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-65be377f-cecc-4e5e-8a07-414105743ccd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:39.800504 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-65be377f-cecc-4e5e-8a07-414105743ccd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:39.800951 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-65be377f-cecc-4e5e-8a07-414105743ccd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:39.806559 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-65be377f-cecc-4e5e-8a07-414105743ccd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:39.806559 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-65be377f-cecc-4e5e-8a07-414105743ccd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:39.889719 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3098581a-8bc9-4345-9d27-3ce17b83e44d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:39.890578 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3098581a-8bc9-4345-9d27-3ce17b83e44d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:39.899363 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3098581a-8bc9-4345-9d27-3ce17b83e44d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:39.900097 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3098581a-8bc9-4345-9d27-3ce17b83e44d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:39.901373 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3098581a-8bc9-4345-9d27-3ce17b83e44d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:39.903431 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3098581a-8bc9-4345-9d27-3ce17b83e44d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:40.025992 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-65be377f-cecc-4e5e-8a07-414105743ccd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:40.036544 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-65be377f-cecc-4e5e-8a07-414105743ccd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1724 microversion: 2.1 time: 0.251502 Jan 19 16:06:40.039591 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 357/766] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:39 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:40.050767 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-1c0d5fb0-0ab7-4bd8-84ed-f2d740250230 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:40.051534 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-1c0d5fb0-0ab7-4bd8-84ed-f2d740250230 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:40.059451 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1c0d5fb0-0ab7-4bd8-84ed-f2d740250230 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:40.059901 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1c0d5fb0-0ab7-4bd8-84ed-f2d740250230 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:40.061523 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1c0d5fb0-0ab7-4bd8-84ed-f2d740250230 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:40.062826 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1c0d5fb0-0ab7-4bd8-84ed-f2d740250230 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:40.101486 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1c0d5fb0-0ab7-4bd8-84ed-f2d740250230 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:40.102202 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1c0d5fb0-0ab7-4bd8-84ed-f2d740250230 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:40.103561 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.objects.instance [None req-1c0d5fb0-0ab7-4bd8-84ed-f2d740250230 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lazy-loading 'fault' on Instance uuid 51253e38-0958-4960-8f9e-0bfa89782bd9 {{(pid=128875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:06:40.104129 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-3098581a-8bc9-4345-9d27-3ce17b83e44d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:40.113617 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-3098581a-8bc9-4345-9d27-3ce17b83e44d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:40.116001 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-3098581a-8bc9-4345-9d27-3ce17b83e44d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:40.117920 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3098581a-8bc9-4345-9d27-3ce17b83e44d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1741 microversion: 2.20 time: 0.234153 Jan 19 16:06:40.119694 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 410/767] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:39 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1741 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:06:40.184086 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-1c0d5fb0-0ab7-4bd8-84ed-f2d740250230 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:40.194753 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-1c0d5fb0-0ab7-4bd8-84ed-f2d740250230 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9" status: 200 len: 1309 microversion: 2.1 time: 0.156035 Jan 19 16:06:40.196089 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 358/768] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:40 2022] GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9 => generated 1309 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:40.770372 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-77fd83df-c428-4159-9ddf-91ec573c4c73 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:40.771290 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-77fd83df-c428-4159-9ddf-91ec573c4c73 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:40.779516 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-77fd83df-c428-4159-9ddf-91ec573c4c73 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:40.782112 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-77fd83df-c428-4159-9ddf-91ec573c4c73 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:40.782112 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-77fd83df-c428-4159-9ddf-91ec573c4c73 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:40.782112 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-77fd83df-c428-4159-9ddf-91ec573c4c73 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:40.947216 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-77fd83df-c428-4159-9ddf-91ec573c4c73 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:40.956915 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-77fd83df-c428-4159-9ddf-91ec573c4c73 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1513 microversion: 2.1 time: 0.190202 Jan 19 16:06:40.957415 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 411/769] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:40 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:41.054026 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-b6a71191-6063-43b0-8341-065292f48a70 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:41.059522 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-b6a71191-6063-43b0-8341-065292f48a70 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:41.072487 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b6a71191-6063-43b0-8341-065292f48a70 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:41.073284 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b6a71191-6063-43b0-8341-065292f48a70 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:41.074174 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b6a71191-6063-43b0-8341-065292f48a70 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:41.074622 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b6a71191-6063-43b0-8341-065292f48a70 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:41.141097 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-0e5fa80f-6839-4efa-876c-ef7f52b4ea38 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:41.142007 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-0e5fa80f-6839-4efa-876c-ef7f52b4ea38 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:41.148962 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0e5fa80f-6839-4efa-876c-ef7f52b4ea38 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:41.149417 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0e5fa80f-6839-4efa-876c-ef7f52b4ea38 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:41.150258 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0e5fa80f-6839-4efa-876c-ef7f52b4ea38 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:41.150697 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0e5fa80f-6839-4efa-876c-ef7f52b4ea38 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:41.367006 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-0e5fa80f-6839-4efa-876c-ef7f52b4ea38 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:41.377362 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-0e5fa80f-6839-4efa-876c-ef7f52b4ea38 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:41.380402 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-0e5fa80f-6839-4efa-876c-ef7f52b4ea38 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:41.381698 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-0e5fa80f-6839-4efa-876c-ef7f52b4ea38 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1741 microversion: 2.20 time: 0.246566 Jan 19 16:06:41.382611 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 412/770] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:41 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1741 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:06:41.389873 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-00d62178-201d-4388-8c73-1740a9b3ab6a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:41.390889 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-00d62178-201d-4388-8c73-1740a9b3ab6a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 51253e38-0958-4960-8f9e-0bfa89782bd9] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:41.398255 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-00d62178-201d-4388-8c73-1740a9b3ab6a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:41.399096 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-00d62178-201d-4388-8c73-1740a9b3ab6a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:41.400346 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-00d62178-201d-4388-8c73-1740a9b3ab6a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:41.400962 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-00d62178-201d-4388-8c73-1740a9b3ab6a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:41.427203 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.wsgi [None req-00d62178-201d-4388-8c73-1740a9b3ab6a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] HTTP exception thrown: Instance 51253e38-0958-4960-8f9e-0bfa89782bd9 could not be found. Jan 19 16:06:41.428231 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-00d62178-201d-4388-8c73-1740a9b3ab6a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Returning 404 to user: Instance 51253e38-0958-4960-8f9e-0bfa89782bd9 could not be found. {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:06:41.429093 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-00d62178-201d-4388-8c73-1740a9b3ab6a tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9" status: 404 len: 111 microversion: 2.1 time: 0.044839 Jan 19 16:06:41.430018 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 413/771] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:41 2022] GET /compute/v2.1/servers/51253e38-0958-4960-8f9e-0bfa89782bd9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:06:41.754953 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-b6a71191-6063-43b0-8341-065292f48a70 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:41.770446 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-b6a71191-6063-43b0-8341-065292f48a70 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1724 microversion: 2.1 time: 0.720020 Jan 19 16:06:41.789893 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 359/772] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:41 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1724 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:06:41.977913 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ae3ad620-9e6a-42c8-adbf-96a3a2ddcf78 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:41.978646 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ae3ad620-9e6a-42c8-adbf-96a3a2ddcf78 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:41.989343 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ae3ad620-9e6a-42c8-adbf-96a3a2ddcf78 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:41.996059 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ae3ad620-9e6a-42c8-adbf-96a3a2ddcf78 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:41.996059 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ae3ad620-9e6a-42c8-adbf-96a3a2ddcf78 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:41.996059 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ae3ad620-9e6a-42c8-adbf-96a3a2ddcf78 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:42.092020 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ae3ad620-9e6a-42c8-adbf-96a3a2ddcf78 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:42.105390 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ae3ad620-9e6a-42c8-adbf-96a3a2ddcf78 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1471 microversion: 2.1 time: 0.131523 Jan 19 16:06:42.106891 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 414/773] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:41 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1471 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:42.222716 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-2e721391-0b01-4998-b656-e4392106b67f req-d2ac8f99-7aba-4f5e-a5bd-39413e19d13c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6452b53-f8fd-4bcf-853a-b6cba80219d3", "name": "network-vif-deleted", "tag": "5398f5fc-b5dc-409d-a1d1-0ea421ad4c6a"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:06:42.226324 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:06:42.226324 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:06:42.240370 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-2e721391-0b01-4998-b656-e4392106b67f req-d2ac8f99-7aba-4f5e-a5bd-39413e19d13c service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:42.240726 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-2e721391-0b01-4998-b656-e4392106b67f req-d2ac8f99-7aba-4f5e-a5bd-39413e19d13c service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:42.266192 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-2e721391-0b01-4998-b656-e4392106b67f req-d2ac8f99-7aba-4f5e-a5bd-39413e19d13c service nova] Creating event network-vif-deleted:5398f5fc-b5dc-409d-a1d1-0ea421ad4c6a for instance d6452b53-f8fd-4bcf-853a-b6cba80219d3 on hv-cinder-82002 Jan 19 16:06:42.273836 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-2e721391-0b01-4998-b656-e4392106b67f req-d2ac8f99-7aba-4f5e-a5bd-39413e19d13c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058609 Jan 19 16:06:42.275204 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 360/774] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:06:42.435071 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-7b708bda-fd06-4c16-b199-a786067343c5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:42.436570 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-7b708bda-fd06-4c16-b199-a786067343c5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:42.448719 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7b708bda-fd06-4c16-b199-a786067343c5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:42.450065 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7b708bda-fd06-4c16-b199-a786067343c5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:42.452036 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7b708bda-fd06-4c16-b199-a786067343c5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:42.453451 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7b708bda-fd06-4c16-b199-a786067343c5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:42.737921 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-7b708bda-fd06-4c16-b199-a786067343c5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:42.746529 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-7b708bda-fd06-4c16-b199-a786067343c5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:42.748113 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-7b708bda-fd06-4c16-b199-a786067343c5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:42.749322 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-7b708bda-fd06-4c16-b199-a786067343c5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1741 microversion: 2.20 time: 0.333272 Jan 19 16:06:42.750003 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 415/775] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:42 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1741 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:06:42.797459 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-4762bb43-d372-4abc-bd19-a52010882ce3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:42.798241 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-4762bb43-d372-4abc-bd19-a52010882ce3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:42.805579 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4762bb43-d372-4abc-bd19-a52010882ce3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:42.805963 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4762bb43-d372-4abc-bd19-a52010882ce3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:42.806756 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4762bb43-d372-4abc-bd19-a52010882ce3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:42.807220 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4762bb43-d372-4abc-bd19-a52010882ce3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:42.974215 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-4762bb43-d372-4abc-bd19-a52010882ce3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:42.983391 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-4762bb43-d372-4abc-bd19-a52010882ce3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1724 microversion: 2.1 time: 0.193082 Jan 19 16:06:42.987673 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 361/776] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:42 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:43.124115 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a936a3ab-b498-483f-9456-74952b472534 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:43.125213 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a936a3ab-b498-483f-9456-74952b472534 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:43.132720 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a936a3ab-b498-483f-9456-74952b472534 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:43.133167 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a936a3ab-b498-483f-9456-74952b472534 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:43.133999 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a936a3ab-b498-483f-9456-74952b472534 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:43.134440 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a936a3ab-b498-483f-9456-74952b472534 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:43.175464 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a936a3ab-b498-483f-9456-74952b472534 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:43.175916 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a936a3ab-b498-483f-9456-74952b472534 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:43.176376 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.objects.instance [None req-a936a3ab-b498-483f-9456-74952b472534 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lazy-loading 'fault' on Instance uuid d6452b53-f8fd-4bcf-853a-b6cba80219d3 {{(pid=128876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:06:43.222056 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a936a3ab-b498-483f-9456-74952b472534 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:43.231008 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a936a3ab-b498-483f-9456-74952b472534 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1307 microversion: 2.1 time: 0.109568 Jan 19 16:06:43.231008 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 416/777] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:43 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1307 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:43.626164 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-471b4ead-5714-433a-8310-a391fb831970 req-d4362d45-a3c6-4e33-8ebd-4ad9f4b11ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02ba601a-94e7-486f-9d1b-7418ae534f4f", "name": "network-vif-plugged", "status": "completed", "tag": "51ed4245-58bf-4cc7-838e-9cad3734639e"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:06:43.627827 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:06:43.627827 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:06:43.635688 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-471b4ead-5714-433a-8310-a391fb831970 req-d4362d45-a3c6-4e33-8ebd-4ad9f4b11ac8 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:43.636380 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-471b4ead-5714-433a-8310-a391fb831970 req-d4362d45-a3c6-4e33-8ebd-4ad9f4b11ac8 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:43.648471 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-471b4ead-5714-433a-8310-a391fb831970 req-d4362d45-a3c6-4e33-8ebd-4ad9f4b11ac8 service nova] Creating event network-vif-plugged:51ed4245-58bf-4cc7-838e-9cad3734639e for instance 02ba601a-94e7-486f-9d1b-7418ae534f4f on hv-cinder-82002 Jan 19 16:06:43.653646 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-471b4ead-5714-433a-8310-a391fb831970 req-d4362d45-a3c6-4e33-8ebd-4ad9f4b11ac8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031657 Jan 19 16:06:43.654261 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 362/778] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:06:43.774057 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c53daf8d-5dde-445e-a33f-f8e3880adce2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:43.775533 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c53daf8d-5dde-445e-a33f-f8e3880adce2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:43.785684 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c53daf8d-5dde-445e-a33f-f8e3880adce2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:43.787312 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c53daf8d-5dde-445e-a33f-f8e3880adce2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:43.788588 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c53daf8d-5dde-445e-a33f-f8e3880adce2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:43.792575 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c53daf8d-5dde-445e-a33f-f8e3880adce2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:43.982779 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c53daf8d-5dde-445e-a33f-f8e3880adce2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:43.998279 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c53daf8d-5dde-445e-a33f-f8e3880adce2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:44.002335 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c53daf8d-5dde-445e-a33f-f8e3880adce2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:44.004970 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c53daf8d-5dde-445e-a33f-f8e3880adce2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1741 microversion: 2.20 time: 0.238007 Jan 19 16:06:44.006238 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 417/779] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:43 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1741 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:06:44.011613 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e79b58b9-5383-4345-b494-7b2c30d2a57f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:44.012716 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-e79b58b9-5383-4345-b494-7b2c30d2a57f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:44.022378 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e79b58b9-5383-4345-b494-7b2c30d2a57f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:44.023154 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e79b58b9-5383-4345-b494-7b2c30d2a57f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:44.024332 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e79b58b9-5383-4345-b494-7b2c30d2a57f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:44.024928 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e79b58b9-5383-4345-b494-7b2c30d2a57f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:44.247413 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-202d2f97-22e7-4748-8d5f-e58204e0bc92 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:44.248917 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-202d2f97-22e7-4748-8d5f-e58204e0bc92 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:44.257242 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-202d2f97-22e7-4748-8d5f-e58204e0bc92 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:44.258070 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-202d2f97-22e7-4748-8d5f-e58204e0bc92 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:44.259270 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-202d2f97-22e7-4748-8d5f-e58204e0bc92 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:44.259910 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-202d2f97-22e7-4748-8d5f-e58204e0bc92 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:44.265523 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e79b58b9-5383-4345-b494-7b2c30d2a57f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:44.291205 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e79b58b9-5383-4345-b494-7b2c30d2a57f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1724 microversion: 2.1 time: 0.285861 Jan 19 16:06:44.292086 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 363/780] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:44 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:44.312640 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-202d2f97-22e7-4748-8d5f-e58204e0bc92 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:44.313363 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-202d2f97-22e7-4748-8d5f-e58204e0bc92 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:44.314009 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.objects.instance [None req-202d2f97-22e7-4748-8d5f-e58204e0bc92 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lazy-loading 'fault' on Instance uuid d6452b53-f8fd-4bcf-853a-b6cba80219d3 {{(pid=128876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:06:44.371570 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-202d2f97-22e7-4748-8d5f-e58204e0bc92 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:44.388402 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-202d2f97-22e7-4748-8d5f-e58204e0bc92 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1307 microversion: 2.1 time: 0.145979 Jan 19 16:06:44.402317 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 418/781] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:44 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1307 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:06:45.035646 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-debdf5f8-a11e-4deb-bceb-a67c829be9fc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:45.036739 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-debdf5f8-a11e-4deb-bceb-a67c829be9fc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:45.044254 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-debdf5f8-a11e-4deb-bceb-a67c829be9fc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:45.044698 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-debdf5f8-a11e-4deb-bceb-a67c829be9fc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:45.045612 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-debdf5f8-a11e-4deb-bceb-a67c829be9fc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:45.046046 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-debdf5f8-a11e-4deb-bceb-a67c829be9fc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:45.227449 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-debdf5f8-a11e-4deb-bceb-a67c829be9fc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:45.240654 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-debdf5f8-a11e-4deb-bceb-a67c829be9fc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:45.242191 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-debdf5f8-a11e-4deb-bceb-a67c829be9fc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:45.243422 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-debdf5f8-a11e-4deb-bceb-a67c829be9fc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1741 microversion: 2.20 time: 0.212748 Jan 19 16:06:45.244006 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 364/782] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:45 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1741 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:06:45.321379 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-01c298c7-c05c-4809-97e2-4262f38a01eb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:45.322348 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-01c298c7-c05c-4809-97e2-4262f38a01eb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:45.331834 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-01c298c7-c05c-4809-97e2-4262f38a01eb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:45.332300 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-01c298c7-c05c-4809-97e2-4262f38a01eb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:45.333254 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-01c298c7-c05c-4809-97e2-4262f38a01eb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:45.333846 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-01c298c7-c05c-4809-97e2-4262f38a01eb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:45.411243 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-682ae752-a2b3-48a3-ac98-601a7a1771c3 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:45.412424 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-682ae752-a2b3-48a3-ac98-601a7a1771c3 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:45.420758 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-682ae752-a2b3-48a3-ac98-601a7a1771c3 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:45.421411 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-682ae752-a2b3-48a3-ac98-601a7a1771c3 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:45.422718 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-682ae752-a2b3-48a3-ac98-601a7a1771c3 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:45.423362 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-682ae752-a2b3-48a3-ac98-601a7a1771c3 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:45.458324 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-682ae752-a2b3-48a3-ac98-601a7a1771c3 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:45.459326 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-682ae752-a2b3-48a3-ac98-601a7a1771c3 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:45.460004 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.objects.instance [None req-682ae752-a2b3-48a3-ac98-601a7a1771c3 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lazy-loading 'fault' on Instance uuid d6452b53-f8fd-4bcf-853a-b6cba80219d3 {{(pid=128875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:06:45.513743 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-01c298c7-c05c-4809-97e2-4262f38a01eb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:45.520323 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-682ae752-a2b3-48a3-ac98-601a7a1771c3 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:45.524609 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-01c298c7-c05c-4809-97e2-4262f38a01eb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1724 microversion: 2.1 time: 0.208972 Jan 19 16:06:45.527928 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 419/783] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:45 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:45.533781 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-682ae752-a2b3-48a3-ac98-601a7a1771c3 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1307 microversion: 2.1 time: 0.126381 Jan 19 16:06:45.534787 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 365/784] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:45 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1307 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:46.272955 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-23bebbdd-79aa-41e0-929c-0616fd8da97d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:46.273921 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-23bebbdd-79aa-41e0-929c-0616fd8da97d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:46.281594 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-23bebbdd-79aa-41e0-929c-0616fd8da97d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:46.282198 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-23bebbdd-79aa-41e0-929c-0616fd8da97d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:46.283516 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-23bebbdd-79aa-41e0-929c-0616fd8da97d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:46.285652 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-23bebbdd-79aa-41e0-929c-0616fd8da97d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:46.487659 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-23bebbdd-79aa-41e0-929c-0616fd8da97d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:46.500897 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-23bebbdd-79aa-41e0-929c-0616fd8da97d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:46.502847 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-23bebbdd-79aa-41e0-929c-0616fd8da97d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:46.504116 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-23bebbdd-79aa-41e0-929c-0616fd8da97d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1741 microversion: 2.20 time: 0.245286 Jan 19 16:06:46.504689 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 420/785] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:46 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1741 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:06:46.542387 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-afa96886-28c4-47ba-a46d-b55f0d09a6f3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:46.543241 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-afa96886-28c4-47ba-a46d-b55f0d09a6f3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:46.550662 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-afa96886-28c4-47ba-a46d-b55f0d09a6f3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:46.551180 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-afa96886-28c4-47ba-a46d-b55f0d09a6f3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:46.551990 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-afa96886-28c4-47ba-a46d-b55f0d09a6f3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:46.552429 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-afa96886-28c4-47ba-a46d-b55f0d09a6f3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:46.561003 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-70a5e315-fb8a-43f2-9a50-2dc1b1bba3e4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:46.562392 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-70a5e315-fb8a-43f2-9a50-2dc1b1bba3e4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:46.570534 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-70a5e315-fb8a-43f2-9a50-2dc1b1bba3e4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:46.571254 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-70a5e315-fb8a-43f2-9a50-2dc1b1bba3e4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:46.572285 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-70a5e315-fb8a-43f2-9a50-2dc1b1bba3e4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:46.572831 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-70a5e315-fb8a-43f2-9a50-2dc1b1bba3e4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:46.625678 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-70a5e315-fb8a-43f2-9a50-2dc1b1bba3e4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:46.627084 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-70a5e315-fb8a-43f2-9a50-2dc1b1bba3e4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:46.627598 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.objects.instance [None req-70a5e315-fb8a-43f2-9a50-2dc1b1bba3e4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lazy-loading 'fault' on Instance uuid d6452b53-f8fd-4bcf-853a-b6cba80219d3 {{(pid=128876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:06:46.673928 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-70a5e315-fb8a-43f2-9a50-2dc1b1bba3e4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:46.682468 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-70a5e315-fb8a-43f2-9a50-2dc1b1bba3e4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1307 microversion: 2.1 time: 0.127846 Jan 19 16:06:46.683562 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 421/786] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:46 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1307 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:46.759080 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-afa96886-28c4-47ba-a46d-b55f0d09a6f3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:46.771796 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-afa96886-28c4-47ba-a46d-b55f0d09a6f3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1724 microversion: 2.1 time: 0.232950 Jan 19 16:06:46.772801 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 366/787] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:46 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:06:47.532326 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a67bf48b-213c-47ed-89b6-0a49e7c8ae8c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:47.532936 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a67bf48b-213c-47ed-89b6-0a49e7c8ae8c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:47.540525 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a67bf48b-213c-47ed-89b6-0a49e7c8ae8c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:47.540868 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a67bf48b-213c-47ed-89b6-0a49e7c8ae8c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:47.541709 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a67bf48b-213c-47ed-89b6-0a49e7c8ae8c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:47.542302 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a67bf48b-213c-47ed-89b6-0a49e7c8ae8c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:47.695311 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a67bf48b-213c-47ed-89b6-0a49e7c8ae8c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:47.704274 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a67bf48b-213c-47ed-89b6-0a49e7c8ae8c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:47.705839 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a67bf48b-213c-47ed-89b6-0a49e7c8ae8c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:47.707087 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a67bf48b-213c-47ed-89b6-0a49e7c8ae8c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1741 microversion: 2.20 time: 0.179309 Jan 19 16:06:47.707676 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 422/788] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:47 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1741 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:06:47.707837 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f8acc2af-aedc-438d-9e2e-4ffcd11c3320 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:47.708348 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-f8acc2af-aedc-438d-9e2e-4ffcd11c3320 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:47.718829 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f8acc2af-aedc-438d-9e2e-4ffcd11c3320 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:47.719697 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f8acc2af-aedc-438d-9e2e-4ffcd11c3320 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:47.721186 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f8acc2af-aedc-438d-9e2e-4ffcd11c3320 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:47.721976 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f8acc2af-aedc-438d-9e2e-4ffcd11c3320 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:47.762899 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f8acc2af-aedc-438d-9e2e-4ffcd11c3320 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:47.763367 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f8acc2af-aedc-438d-9e2e-4ffcd11c3320 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:47.763823 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.objects.instance [None req-f8acc2af-aedc-438d-9e2e-4ffcd11c3320 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lazy-loading 'fault' on Instance uuid d6452b53-f8fd-4bcf-853a-b6cba80219d3 {{(pid=128875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:06:47.796899 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f18e86d3-7a75-448e-bda4-df3078898170 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:47.797380 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f18e86d3-7a75-448e-bda4-df3078898170 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:47.804083 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f18e86d3-7a75-448e-bda4-df3078898170 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:47.804516 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f18e86d3-7a75-448e-bda4-df3078898170 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:47.810151 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f18e86d3-7a75-448e-bda4-df3078898170 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:47.810151 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f18e86d3-7a75-448e-bda4-df3078898170 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:47.811414 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-f8acc2af-aedc-438d-9e2e-4ffcd11c3320 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:47.823016 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f8acc2af-aedc-438d-9e2e-4ffcd11c3320 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 200 len: 1307 microversion: 2.1 time: 0.118351 Jan 19 16:06:47.823875 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 367/789] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:47 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 1307 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:06:47.963365 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f18e86d3-7a75-448e-bda4-df3078898170 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:47.971234 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f18e86d3-7a75-448e-bda4-df3078898170 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1724 microversion: 2.1 time: 0.178969 Jan 19 16:06:47.971822 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 423/790] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:47 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:06:48.728202 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c0d78e27-ef43-48cb-b59e-a58522a76004 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:48.728806 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c0d78e27-ef43-48cb-b59e-a58522a76004 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:48.736967 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c0d78e27-ef43-48cb-b59e-a58522a76004 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:48.737777 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c0d78e27-ef43-48cb-b59e-a58522a76004 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:48.740983 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c0d78e27-ef43-48cb-b59e-a58522a76004 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:48.740983 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c0d78e27-ef43-48cb-b59e-a58522a76004 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:48.849668 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-bba889da-30cb-4aba-8608-3b0bf5047d22 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:48.850381 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-bba889da-30cb-4aba-8608-3b0bf5047d22 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: d6452b53-f8fd-4bcf-853a-b6cba80219d3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:48.860339 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bba889da-30cb-4aba-8608-3b0bf5047d22 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:48.860876 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bba889da-30cb-4aba-8608-3b0bf5047d22 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:48.862131 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bba889da-30cb-4aba-8608-3b0bf5047d22 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:48.862700 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bba889da-30cb-4aba-8608-3b0bf5047d22 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:48.879868 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.wsgi [None req-bba889da-30cb-4aba-8608-3b0bf5047d22 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] HTTP exception thrown: Instance d6452b53-f8fd-4bcf-853a-b6cba80219d3 could not be found. Jan 19 16:06:48.880641 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-bba889da-30cb-4aba-8608-3b0bf5047d22 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Returning 404 to user: Instance d6452b53-f8fd-4bcf-853a-b6cba80219d3 could not be found. {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:06:48.881615 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-bba889da-30cb-4aba-8608-3b0bf5047d22 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3" status: 404 len: 111 microversion: 2.1 time: 0.037130 Jan 19 16:06:48.882346 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 424/791] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:48 2022] GET /compute/v2.1/servers/d6452b53-f8fd-4bcf-853a-b6cba80219d3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 16:06:48.950006 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c0d78e27-ef43-48cb-b59e-a58522a76004 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:48.961424 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c0d78e27-ef43-48cb-b59e-a58522a76004 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:48.962760 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c0d78e27-ef43-48cb-b59e-a58522a76004 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:48.964348 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c0d78e27-ef43-48cb-b59e-a58522a76004 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1741 microversion: 2.20 time: 0.240911 Jan 19 16:06:48.965226 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 368/792] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:48 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1741 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:06:48.988652 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-dd6eadc3-0dcb-44e8-9af9-83e5d1e6c958 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:48.989259 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-dd6eadc3-0dcb-44e8-9af9-83e5d1e6c958 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:48.998344 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dd6eadc3-0dcb-44e8-9af9-83e5d1e6c958 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:48.998344 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dd6eadc3-0dcb-44e8-9af9-83e5d1e6c958 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:48.998344 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dd6eadc3-0dcb-44e8-9af9-83e5d1e6c958 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:48.998344 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dd6eadc3-0dcb-44e8-9af9-83e5d1e6c958 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:49.170327 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-dd6eadc3-0dcb-44e8-9af9-83e5d1e6c958 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:49.181366 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-dd6eadc3-0dcb-44e8-9af9-83e5d1e6c958 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1724 microversion: 2.1 time: 0.196345 Jan 19 16:06:49.182412 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 425/793] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:48 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:49.984093 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-4c99f862-97ef-465d-a2cd-8a0d5e34997e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:49.984791 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-4c99f862-97ef-465d-a2cd-8a0d5e34997e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:49.991842 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4c99f862-97ef-465d-a2cd-8a0d5e34997e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:49.992288 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4c99f862-97ef-465d-a2cd-8a0d5e34997e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:49.995356 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4c99f862-97ef-465d-a2cd-8a0d5e34997e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:49.995356 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4c99f862-97ef-465d-a2cd-8a0d5e34997e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:50.199183 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-21863cc6-d801-40cc-9e23-b2844bd6542b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:50.200100 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-21863cc6-d801-40cc-9e23-b2844bd6542b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:50.207525 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-21863cc6-d801-40cc-9e23-b2844bd6542b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:50.207953 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-21863cc6-d801-40cc-9e23-b2844bd6542b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:50.208914 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-21863cc6-d801-40cc-9e23-b2844bd6542b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:50.209369 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-21863cc6-d801-40cc-9e23-b2844bd6542b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:50.214747 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-4c99f862-97ef-465d-a2cd-8a0d5e34997e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:50.229037 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-4c99f862-97ef-465d-a2cd-8a0d5e34997e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:50.232937 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-4c99f862-97ef-465d-a2cd-8a0d5e34997e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:50.239758 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-4c99f862-97ef-465d-a2cd-8a0d5e34997e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1741 microversion: 2.20 time: 0.254952 Jan 19 16:06:50.239758 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 369/794] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:49 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1741 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:06:50.249054 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-419092b5-a2db-48a4-8858-68bca6ffe1a5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:50.249692 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-419092b5-a2db-48a4-8858-68bca6ffe1a5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:50.257633 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-419092b5-a2db-48a4-8858-68bca6ffe1a5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:50.260716 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-419092b5-a2db-48a4-8858-68bca6ffe1a5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:50.260716 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-419092b5-a2db-48a4-8858-68bca6ffe1a5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:50.260716 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-419092b5-a2db-48a4-8858-68bca6ffe1a5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:50.311377 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-419092b5-a2db-48a4-8858-68bca6ffe1a5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Going to try to terminate instance {{(pid=128875) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:06:50.434726 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-21863cc6-d801-40cc-9e23-b2844bd6542b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:50.449242 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-21863cc6-d801-40cc-9e23-b2844bd6542b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1724 microversion: 2.1 time: 0.253477 Jan 19 16:06:50.450390 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 426/795] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:50 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:50.724134 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-419092b5-a2db-48a4-8858-68bca6ffe1a5 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 204 len: 0 microversion: 2.1 time: 0.477298 Jan 19 16:06:50.726307 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 370/796] 10.222.0.58 () {58 vars in 1238 bytes} [Wed Jan 19 16:06:50 2022] DELETE /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:06:50.734871 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ff56786b-18c2-4263-b9e1-f396232d81d6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:50.735507 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ff56786b-18c2-4263-b9e1-f396232d81d6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:50.741518 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ff56786b-18c2-4263-b9e1-f396232d81d6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:50.741959 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ff56786b-18c2-4263-b9e1-f396232d81d6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:50.742740 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ff56786b-18c2-4263-b9e1-f396232d81d6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:50.743194 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ff56786b-18c2-4263-b9e1-f396232d81d6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:50.917284 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ff56786b-18c2-4263-b9e1-f396232d81d6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:50.925813 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ff56786b-18c2-4263-b9e1-f396232d81d6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1514 microversion: 2.1 time: 0.195082 Jan 19 16:06:50.926396 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 427/797] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:50 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1514 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:51.260867 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-983fe961-024d-4f57-9d04-ca595077b7e4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:51.261665 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-983fe961-024d-4f57-9d04-ca595077b7e4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:51.270306 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-983fe961-024d-4f57-9d04-ca595077b7e4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:51.270748 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-983fe961-024d-4f57-9d04-ca595077b7e4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:51.271571 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-983fe961-024d-4f57-9d04-ca595077b7e4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:51.272210 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-983fe961-024d-4f57-9d04-ca595077b7e4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:51.432492 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-983fe961-024d-4f57-9d04-ca595077b7e4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:51.441775 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-983fe961-024d-4f57-9d04-ca595077b7e4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:51.443659 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-983fe961-024d-4f57-9d04-ca595077b7e4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:51.445135 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-983fe961-024d-4f57-9d04-ca595077b7e4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1736 microversion: 2.20 time: 0.192464 Jan 19 16:06:51.446206 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 371/798] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:51 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:06:51.468044 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-37ed4995-f1a5-400a-9c75-3281a0749e71 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:51.469628 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-37ed4995-f1a5-400a-9c75-3281a0749e71 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:51.476525 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-37ed4995-f1a5-400a-9c75-3281a0749e71 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:51.477359 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-37ed4995-f1a5-400a-9c75-3281a0749e71 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:51.478519 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-37ed4995-f1a5-400a-9c75-3281a0749e71 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:51.479451 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-37ed4995-f1a5-400a-9c75-3281a0749e71 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:51.685321 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-37ed4995-f1a5-400a-9c75-3281a0749e71 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:51.696195 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-37ed4995-f1a5-400a-9c75-3281a0749e71 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1724 microversion: 2.1 time: 0.231897 Jan 19 16:06:51.697310 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 428/799] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:51 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:51.950415 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6d4e6ab7-1a93-44a5-8522-e0778806a46d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:51.951919 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-6d4e6ab7-1a93-44a5-8522-e0778806a46d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:51.961740 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6d4e6ab7-1a93-44a5-8522-e0778806a46d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:51.966390 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6d4e6ab7-1a93-44a5-8522-e0778806a46d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:51.969897 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6d4e6ab7-1a93-44a5-8522-e0778806a46d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:51.971192 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6d4e6ab7-1a93-44a5-8522-e0778806a46d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:52.178141 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6d4e6ab7-1a93-44a5-8522-e0778806a46d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:52.196256 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6d4e6ab7-1a93-44a5-8522-e0778806a46d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1514 microversion: 2.1 time: 0.254354 Jan 19 16:06:52.197656 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 372/800] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:51 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1514 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:52.473853 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-39d5c674-bd34-4832-a998-e0b64d175b3d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:52.475412 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-39d5c674-bd34-4832-a998-e0b64d175b3d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:52.485528 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-39d5c674-bd34-4832-a998-e0b64d175b3d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:52.486281 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-39d5c674-bd34-4832-a998-e0b64d175b3d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:52.487535 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-39d5c674-bd34-4832-a998-e0b64d175b3d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:52.488137 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-39d5c674-bd34-4832-a998-e0b64d175b3d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:52.663867 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-39d5c674-bd34-4832-a998-e0b64d175b3d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:52.676089 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-39d5c674-bd34-4832-a998-e0b64d175b3d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:52.678563 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-39d5c674-bd34-4832-a998-e0b64d175b3d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:52.680145 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-39d5c674-bd34-4832-a998-e0b64d175b3d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1736 microversion: 2.20 time: 0.214452 Jan 19 16:06:52.680820 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 429/801] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:52 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:06:52.727188 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6686337e-0eef-4220-9d35-48d6baf428b0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:52.728544 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-6686337e-0eef-4220-9d35-48d6baf428b0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:52.751756 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6686337e-0eef-4220-9d35-48d6baf428b0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:52.752113 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6686337e-0eef-4220-9d35-48d6baf428b0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:52.752943 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6686337e-0eef-4220-9d35-48d6baf428b0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:52.753401 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6686337e-0eef-4220-9d35-48d6baf428b0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:52.919705 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6686337e-0eef-4220-9d35-48d6baf428b0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:52.930610 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6686337e-0eef-4220-9d35-48d6baf428b0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1724 microversion: 2.1 time: 0.213300 Jan 19 16:06:52.932017 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 373/802] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:52 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:53.216150 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ed86b06a-c857-4c7c-a65c-36e0e817c081 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:53.217038 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ed86b06a-c857-4c7c-a65c-36e0e817c081 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:53.224967 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ed86b06a-c857-4c7c-a65c-36e0e817c081 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:53.225411 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ed86b06a-c857-4c7c-a65c-36e0e817c081 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:53.226208 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ed86b06a-c857-4c7c-a65c-36e0e817c081 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:53.226632 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ed86b06a-c857-4c7c-a65c-36e0e817c081 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:53.492944 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ed86b06a-c857-4c7c-a65c-36e0e817c081 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:53.501867 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ed86b06a-c857-4c7c-a65c-36e0e817c081 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1514 microversion: 2.1 time: 0.289356 Jan 19 16:06:53.503064 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 430/803] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:53 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1514 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:53.707048 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-dcd6b404-2842-45a0-9dcc-c8fd92163901 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:53.708046 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-dcd6b404-2842-45a0-9dcc-c8fd92163901 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:53.714269 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-dcd6b404-2842-45a0-9dcc-c8fd92163901 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:53.714900 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-dcd6b404-2842-45a0-9dcc-c8fd92163901 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:53.715882 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-dcd6b404-2842-45a0-9dcc-c8fd92163901 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:53.716363 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-dcd6b404-2842-45a0-9dcc-c8fd92163901 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:53.889439 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-dcd6b404-2842-45a0-9dcc-c8fd92163901 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:53.901593 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-dcd6b404-2842-45a0-9dcc-c8fd92163901 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:53.903142 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-dcd6b404-2842-45a0-9dcc-c8fd92163901 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:53.904598 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-dcd6b404-2842-45a0-9dcc-c8fd92163901 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1736 microversion: 2.20 time: 0.202536 Jan 19 16:06:53.905193 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 374/804] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:53 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1736 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:06:53.948362 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-43dc53fd-4be2-4d75-a1cf-17fc672225aa tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:53.948986 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-43dc53fd-4be2-4d75-a1cf-17fc672225aa tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:53.962792 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-43dc53fd-4be2-4d75-a1cf-17fc672225aa tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:53.963301 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-43dc53fd-4be2-4d75-a1cf-17fc672225aa tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:53.964137 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-43dc53fd-4be2-4d75-a1cf-17fc672225aa tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:53.964585 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-43dc53fd-4be2-4d75-a1cf-17fc672225aa tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:54.114131 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-43dc53fd-4be2-4d75-a1cf-17fc672225aa tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:54.122413 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-43dc53fd-4be2-4d75-a1cf-17fc672225aa tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1724 microversion: 2.1 time: 0.177757 Jan 19 16:06:54.123021 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 431/805] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:53 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:54.518861 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-7682cc99-7103-4d90-837d-e9777b02037d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:54.519529 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-7682cc99-7103-4d90-837d-e9777b02037d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:54.525439 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7682cc99-7103-4d90-837d-e9777b02037d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:54.525873 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7682cc99-7103-4d90-837d-e9777b02037d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:54.526651 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7682cc99-7103-4d90-837d-e9777b02037d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:54.527108 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7682cc99-7103-4d90-837d-e9777b02037d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:54.665826 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-7682cc99-7103-4d90-837d-e9777b02037d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:54.673816 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-7682cc99-7103-4d90-837d-e9777b02037d tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1514 microversion: 2.1 time: 0.158559 Jan 19 16:06:54.674598 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 375/806] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:54 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:54.925481 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8d61fa61-2927-48e8-8cb1-2f4790fe66f8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:54.926004 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-8d61fa61-2927-48e8-8cb1-2f4790fe66f8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:54.932964 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8d61fa61-2927-48e8-8cb1-2f4790fe66f8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:54.933412 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8d61fa61-2927-48e8-8cb1-2f4790fe66f8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:54.934194 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8d61fa61-2927-48e8-8cb1-2f4790fe66f8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:54.934883 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8d61fa61-2927-48e8-8cb1-2f4790fe66f8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:55.110098 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8d61fa61-2927-48e8-8cb1-2f4790fe66f8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:55.119072 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8d61fa61-2927-48e8-8cb1-2f4790fe66f8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:55.121456 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8d61fa61-2927-48e8-8cb1-2f4790fe66f8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:55.123897 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-8d61fa61-2927-48e8-8cb1-2f4790fe66f8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1736 microversion: 2.20 time: 0.203304 Jan 19 16:06:55.125078 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 432/807] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:54 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1736 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:06:55.143993 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6ba74cd6-d8a4-4dcf-8981-28f09f931743 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:55.147520 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-6ba74cd6-d8a4-4dcf-8981-28f09f931743 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:55.159045 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6ba74cd6-d8a4-4dcf-8981-28f09f931743 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:55.159928 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6ba74cd6-d8a4-4dcf-8981-28f09f931743 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:55.160476 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6ba74cd6-d8a4-4dcf-8981-28f09f931743 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:55.161660 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6ba74cd6-d8a4-4dcf-8981-28f09f931743 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:55.336440 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6ba74cd6-d8a4-4dcf-8981-28f09f931743 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:55.347917 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6ba74cd6-d8a4-4dcf-8981-28f09f931743 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1724 microversion: 2.1 time: 0.207512 Jan 19 16:06:55.358087 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 376/808] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:55 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:55.690847 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-46e7571e-2aac-4427-a2b2-cdbf8badd930 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:55.691995 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-46e7571e-2aac-4427-a2b2-cdbf8badd930 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:55.702345 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-46e7571e-2aac-4427-a2b2-cdbf8badd930 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:55.703466 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-46e7571e-2aac-4427-a2b2-cdbf8badd930 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:55.704298 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-46e7571e-2aac-4427-a2b2-cdbf8badd930 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:55.704745 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-46e7571e-2aac-4427-a2b2-cdbf8badd930 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:55.894645 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-46e7571e-2aac-4427-a2b2-cdbf8badd930 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:55.903696 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-46e7571e-2aac-4427-a2b2-cdbf8badd930 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1514 microversion: 2.1 time: 0.217454 Jan 19 16:06:55.904502 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 433/809] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:55 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1514 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:06:56.145630 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-0133c0f4-8279-4ce7-8b6f-ee2adddf9347 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:56.146342 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-0133c0f4-8279-4ce7-8b6f-ee2adddf9347 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:56.156826 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0133c0f4-8279-4ce7-8b6f-ee2adddf9347 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:56.157640 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0133c0f4-8279-4ce7-8b6f-ee2adddf9347 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:56.158719 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0133c0f4-8279-4ce7-8b6f-ee2adddf9347 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:56.159791 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0133c0f4-8279-4ce7-8b6f-ee2adddf9347 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:56.338295 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-0133c0f4-8279-4ce7-8b6f-ee2adddf9347 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:56.350161 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-0133c0f4-8279-4ce7-8b6f-ee2adddf9347 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:56.352325 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-0133c0f4-8279-4ce7-8b6f-ee2adddf9347 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:56.353856 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-0133c0f4-8279-4ce7-8b6f-ee2adddf9347 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1736 microversion: 2.20 time: 0.212140 Jan 19 16:06:56.355035 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 377/810] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:56 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:06:56.377249 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-4fa6a6d4-faac-486f-91d3-eee7cc1eba9f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:56.378482 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-4fa6a6d4-faac-486f-91d3-eee7cc1eba9f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:56.385622 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4fa6a6d4-faac-486f-91d3-eee7cc1eba9f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:56.386404 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4fa6a6d4-faac-486f-91d3-eee7cc1eba9f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:56.387469 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4fa6a6d4-faac-486f-91d3-eee7cc1eba9f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:56.388182 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4fa6a6d4-faac-486f-91d3-eee7cc1eba9f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:56.599193 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-4fa6a6d4-faac-486f-91d3-eee7cc1eba9f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:56.614715 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-4fa6a6d4-faac-486f-91d3-eee7cc1eba9f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1701 microversion: 2.1 time: 0.239658 Jan 19 16:06:56.614715 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 434/811] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:56 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1701 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:56.630445 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-670706ba-231c-4e5a-8ef4-85b4539db74b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:06:56.642697 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-670706ba-231c-4e5a-8ef4-85b4539db74b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:56.643206 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-670706ba-231c-4e5a-8ef4-85b4539db74b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:56.667029 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3c5ebd08-7934-4b84-b31e-75434a96f3a0 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-722699844", "imageRef": "6d9c05bd-015a-44de-bd51-f744cb247e7a", "flavorRef": "452", "networks": [{"uuid": "1b436032-e8e9-486b-8f5b-70682e8ec306"}]}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:06:56.671796 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-670706ba-231c-4e5a-8ef4-85b4539db74b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Going to try to start instance {{(pid=128875) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 19 16:06:56.730275 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.network.neutron [None req-3c5ebd08-7934-4b84-b31e-75434a96f3a0 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] validate_networks() for [('1b436032-e8e9-486b-8f5b-70682e8ec306', None, None, None, None, None)] {{(pid=128876) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:06:56.955710 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-670706ba-231c-4e5a-8ef4-85b4539db74b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 202 len: 0 microversion: 2.1 time: 0.327640 Jan 19 16:06:56.959027 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 378/812] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:06:56 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:06:56.977596 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-88bace24-3061-444a-b83c-8296df61fc0b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:56.980737 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-88bace24-3061-444a-b83c-8296df61fc0b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:56.997646 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-88bace24-3061-444a-b83c-8296df61fc0b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:57.000700 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-88bace24-3061-444a-b83c-8296df61fc0b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:57.001932 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-88bace24-3061-444a-b83c-8296df61fc0b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:57.002056 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-88bace24-3061-444a-b83c-8296df61fc0b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:57.148075 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-3c5ebd08-7934-4b84-b31e-75434a96f3a0 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Flavor limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:06:57.148934 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-3c5ebd08-7934-4b84-b31e-75434a96f3a0 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Image limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:06:57.149632 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-3c5ebd08-7934-4b84-b31e-75434a96f3a0 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Flavor pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:06:57.150252 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-3c5ebd08-7934-4b84-b31e-75434a96f3a0 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Image pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:06:57.150869 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-3c5ebd08-7934-4b84-b31e-75434a96f3a0 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:06:57.160922 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3c5ebd08-7934-4b84-b31e-75434a96f3a0 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:57.161736 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3c5ebd08-7934-4b84-b31e-75434a96f3a0 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:57.162927 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3c5ebd08-7934-4b84-b31e-75434a96f3a0 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:57.164029 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3c5ebd08-7934-4b84-b31e-75434a96f3a0 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:57.184665 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-88bace24-3061-444a-b83c-8296df61fc0b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:57.191026 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-3c5ebd08-7934-4b84-b31e-75434a96f3a0 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Getting quotas for project 1c338a65c4354429b3e8afe68e5a754d. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:06:57.193441 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-88bace24-3061-444a-b83c-8296df61fc0b tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1514 microversion: 2.1 time: 0.234992 Jan 19 16:06:57.194031 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 379/813] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:56 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1514 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:57.198787 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c24e8979-ba7b-43d9-a691-12321e02fce6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:57.199538 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c24e8979-ba7b-43d9-a691-12321e02fce6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:57.205041 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-3c5ebd08-7934-4b84-b31e-75434a96f3a0 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Getting quotas for user 1d4be467c547439aa51edb2b18d2f906 and project 1c338a65c4354429b3e8afe68e5a754d. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:06:57.207474 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c24e8979-ba7b-43d9-a691-12321e02fce6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:57.208160 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c24e8979-ba7b-43d9-a691-12321e02fce6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:57.209188 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c24e8979-ba7b-43d9-a691-12321e02fce6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:57.209837 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c24e8979-ba7b-43d9-a691-12321e02fce6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:57.281359 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3c5ebd08-7934-4b84-b31e-75434a96f3a0 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Going to run 1 instances... {{(pid=128876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:06:57.281359 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3c5ebd08-7934-4b84-b31e-75434a96f3a0 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 7bc80974-719e-4432-9f6e-2f00a7bf09a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6d9c05bd-015a-44de-bd51-f744cb247e7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:06:57.374612 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c24e8979-ba7b-43d9-a691-12321e02fce6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:57.387895 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c24e8979-ba7b-43d9-a691-12321e02fce6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1710 microversion: 2.1 time: 0.192384 Jan 19 16:06:57.389036 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 380/814] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:57 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1710 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:57.398044 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-73ba2854-5be0-4fc3-b9e9-709dd175b0d6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:57.406775 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-73ba2854-5be0-4fc3-b9e9-709dd175b0d6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:57.406775 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-73ba2854-5be0-4fc3-b9e9-709dd175b0d6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:57.406775 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-73ba2854-5be0-4fc3-b9e9-709dd175b0d6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:57.407655 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-73ba2854-5be0-4fc3-b9e9-709dd175b0d6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:57.408092 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-73ba2854-5be0-4fc3-b9e9-709dd175b0d6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:57.478894 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3c5ebd08-7934-4b84-b31e-75434a96f3a0 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.816761 Jan 19 16:06:57.480304 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 435/815] 10.222.0.58 () {60 vars in 1146 bytes} [Wed Jan 19 16:06:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:06:57.491481 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-37108a44-c0e0-493a-a4b2-b6711423a009 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:57.492589 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-37108a44-c0e0-493a-a4b2-b6711423a009 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 7bc80974-719e-4432-9f6e-2f00a7bf09a3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:57.585666 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-37108a44-c0e0-493a-a4b2-b6711423a009 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:57.592833 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-37108a44-c0e0-493a-a4b2-b6711423a009 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3" status: 200 len: 1218 microversion: 2.1 time: 0.105649 Jan 19 16:06:57.595370 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 436/816] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:57 2022] GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3 => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:57.616039 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-73ba2854-5be0-4fc3-b9e9-709dd175b0d6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:57.624183 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-73ba2854-5be0-4fc3-b9e9-709dd175b0d6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:57.625735 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-73ba2854-5be0-4fc3-b9e9-709dd175b0d6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:57.626915 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-73ba2854-5be0-4fc3-b9e9-709dd175b0d6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1736 microversion: 2.20 time: 0.234933 Jan 19 16:06:57.627512 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 381/817] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:57 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1736 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:06:58.212597 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-0c9a8907-1563-4f7b-9863-15eab7b3f0cf tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:58.213274 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-0c9a8907-1563-4f7b-9863-15eab7b3f0cf tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:58.223691 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0c9a8907-1563-4f7b-9863-15eab7b3f0cf tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:58.223691 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0c9a8907-1563-4f7b-9863-15eab7b3f0cf tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:58.223691 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0c9a8907-1563-4f7b-9863-15eab7b3f0cf tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:58.223691 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0c9a8907-1563-4f7b-9863-15eab7b3f0cf tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:58.406895 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c1992435-4f2e-49a6-8574-7fad60c04df8 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:58.407561 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c1992435-4f2e-49a6-8574-7fad60c04df8 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:58.418153 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c1992435-4f2e-49a6-8574-7fad60c04df8 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:58.418898 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c1992435-4f2e-49a6-8574-7fad60c04df8 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:58.419968 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c1992435-4f2e-49a6-8574-7fad60c04df8 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:58.423456 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c1992435-4f2e-49a6-8574-7fad60c04df8 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:58.441453 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-0c9a8907-1563-4f7b-9863-15eab7b3f0cf tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:58.450780 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-0c9a8907-1563-4f7b-9863-15eab7b3f0cf tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1514 microversion: 2.1 time: 0.242468 Jan 19 16:06:58.452333 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 437/818] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:58 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1514 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:58.589991 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c1992435-4f2e-49a6-8574-7fad60c04df8 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:58.604632 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c1992435-4f2e-49a6-8574-7fad60c04df8 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1710 microversion: 2.1 time: 0.201763 Jan 19 16:06:58.605255 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 382/819] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:58 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1710 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:58.619447 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f977876d-6ca5-4be6-a6af-2df558116021 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:58.620590 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f977876d-6ca5-4be6-a6af-2df558116021 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 7bc80974-719e-4432-9f6e-2f00a7bf09a3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:58.646417 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-413013f5-e852-41af-a027-198d7f171118 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:58.647715 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-413013f5-e852-41af-a027-198d7f171118 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:58.656390 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-413013f5-e852-41af-a027-198d7f171118 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:58.657230 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-413013f5-e852-41af-a027-198d7f171118 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:58.658258 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-413013f5-e852-41af-a027-198d7f171118 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:58.658872 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-413013f5-e852-41af-a027-198d7f171118 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:58.726892 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f977876d-6ca5-4be6-a6af-2df558116021 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:58.739537 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f977876d-6ca5-4be6-a6af-2df558116021 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3" status: 200 len: 1218 microversion: 2.1 time: 0.125427 Jan 19 16:06:58.750131 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 438/820] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:58 2022] GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3 => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:58.861220 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-413013f5-e852-41af-a027-198d7f171118 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:58.870721 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-413013f5-e852-41af-a027-198d7f171118 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:58.872449 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-413013f5-e852-41af-a027-198d7f171118 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:58.873783 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-413013f5-e852-41af-a027-198d7f171118 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1736 microversion: 2.20 time: 0.231367 Jan 19 16:06:58.874414 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 383/821] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:58 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:06:59.471938 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3b670350-ab7a-4f33-ad21-f65b39d750f8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:59.472855 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3b670350-ab7a-4f33-ad21-f65b39d750f8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:59.479877 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3b670350-ab7a-4f33-ad21-f65b39d750f8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:59.480423 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3b670350-ab7a-4f33-ad21-f65b39d750f8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:59.481219 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3b670350-ab7a-4f33-ad21-f65b39d750f8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:59.481724 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3b670350-ab7a-4f33-ad21-f65b39d750f8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:59.625484 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-80cca117-0565-4548-adaf-f355425701aa tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:59.627088 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-80cca117-0565-4548-adaf-f355425701aa tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:59.657126 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-80cca117-0565-4548-adaf-f355425701aa tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:59.657926 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-80cca117-0565-4548-adaf-f355425701aa tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:59.659406 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-80cca117-0565-4548-adaf-f355425701aa tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:59.672094 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-80cca117-0565-4548-adaf-f355425701aa tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:59.694247 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-3b670350-ab7a-4f33-ad21-f65b39d750f8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:59.720834 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3b670350-ab7a-4f33-ad21-f65b39d750f8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1514 microversion: 2.1 time: 0.253133 Jan 19 16:06:59.721835 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 439/822] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:59 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1514 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:06:59.757914 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8886b35d-bd34-438b-8e96-e354fdeeaf6b tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:59.758388 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-8886b35d-bd34-438b-8e96-e354fdeeaf6b tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 7bc80974-719e-4432-9f6e-2f00a7bf09a3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:59.768860 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8886b35d-bd34-438b-8e96-e354fdeeaf6b tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:59.769313 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8886b35d-bd34-438b-8e96-e354fdeeaf6b tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:59.770126 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8886b35d-bd34-438b-8e96-e354fdeeaf6b tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:59.770650 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8886b35d-bd34-438b-8e96-e354fdeeaf6b tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:59.866892 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8886b35d-bd34-438b-8e96-e354fdeeaf6b tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:06:59.874951 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-8886b35d-bd34-438b-8e96-e354fdeeaf6b tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3" status: 200 len: 1222 microversion: 2.1 time: 0.121611 Jan 19 16:06:59.885065 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 440/823] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:59 2022] GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3 => generated 1222 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:06:59.904318 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-49785771-973d-4402-93a3-4f1727e9a53a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:06:59.906665 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-49785771-973d-4402-93a3-4f1727e9a53a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:06:59.912003 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-49785771-973d-4402-93a3-4f1727e9a53a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:59.912720 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-49785771-973d-4402-93a3-4f1727e9a53a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:06:59.913723 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-49785771-973d-4402-93a3-4f1727e9a53a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:06:59.914324 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-49785771-973d-4402-93a3-4f1727e9a53a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:00.028269 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-80cca117-0565-4548-adaf-f355425701aa tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:00.038738 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-80cca117-0565-4548-adaf-f355425701aa tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1710 microversion: 2.1 time: 0.420550 Jan 19 16:07:00.039661 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 384/824] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:06:59 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1710 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:07:00.139036 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-49785771-973d-4402-93a3-4f1727e9a53a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:00.149733 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-49785771-973d-4402-93a3-4f1727e9a53a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:00.151843 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-49785771-973d-4402-93a3-4f1727e9a53a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:00.154351 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-49785771-973d-4402-93a3-4f1727e9a53a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1736 microversion: 2.20 time: 0.252582 Jan 19 16:07:00.154351 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 441/825] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:06:59 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1736 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:00.737435 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e74340b0-86ec-44ba-9372-c76c277813e8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:00.738800 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-e74340b0-86ec-44ba-9372-c76c277813e8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:00.746718 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e74340b0-86ec-44ba-9372-c76c277813e8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:00.747602 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e74340b0-86ec-44ba-9372-c76c277813e8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:00.749363 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e74340b0-86ec-44ba-9372-c76c277813e8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:00.750061 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e74340b0-86ec-44ba-9372-c76c277813e8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:00.896864 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-4131f98f-879c-4db3-9ef1-06f70bf627b1 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:00.897881 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-4131f98f-879c-4db3-9ef1-06f70bf627b1 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 7bc80974-719e-4432-9f6e-2f00a7bf09a3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:00.929513 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4131f98f-879c-4db3-9ef1-06f70bf627b1 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:00.930068 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4131f98f-879c-4db3-9ef1-06f70bf627b1 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:00.933188 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4131f98f-879c-4db3-9ef1-06f70bf627b1 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:00.934530 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4131f98f-879c-4db3-9ef1-06f70bf627b1 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:01.111758 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-4131f98f-879c-4db3-9ef1-06f70bf627b1 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:01.139890 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-4131f98f-879c-4db3-9ef1-06f70bf627b1 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3" status: 200 len: 1270 microversion: 2.1 time: 0.241792 Jan 19 16:07:01.140980 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 442/826] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:00 2022] GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3 => generated 1270 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:07:01.153042 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-20ac4e99-7d0c-4d14-8b0f-1f90c0ddf96b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:01.155116 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-20ac4e99-7d0c-4d14-8b0f-1f90c0ddf96b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:01.162020 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-20ac4e99-7d0c-4d14-8b0f-1f90c0ddf96b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:01.162471 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-20ac4e99-7d0c-4d14-8b0f-1f90c0ddf96b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:01.163973 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-20ac4e99-7d0c-4d14-8b0f-1f90c0ddf96b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:01.164456 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-20ac4e99-7d0c-4d14-8b0f-1f90c0ddf96b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:01.402256 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-20ac4e99-7d0c-4d14-8b0f-1f90c0ddf96b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:01.431094 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-20ac4e99-7d0c-4d14-8b0f-1f90c0ddf96b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1710 microversion: 2.1 time: 0.288028 Jan 19 16:07:01.437619 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 443/827] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:01 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1710 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:07:01.448426 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-85601a7d-ec9d-4e1a-b240-4d209432ef13 req-98d6ae42-60c2-4173-9929-607c31f97dda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad149c5f-bf90-41d8-b480-18b9dafbd058", "name": "network-vif-deleted", "tag": "cb6c185c-94b9-4994-9bb2-8b68be5d0408"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:07:01.457677 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:07:01.457677 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:07:01.464345 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-85601a7d-ec9d-4e1a-b240-4d209432ef13 req-98d6ae42-60c2-4173-9929-607c31f97dda service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:01.465017 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-85601a7d-ec9d-4e1a-b240-4d209432ef13 req-98d6ae42-60c2-4173-9929-607c31f97dda service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:01.486653 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-85601a7d-ec9d-4e1a-b240-4d209432ef13 req-98d6ae42-60c2-4173-9929-607c31f97dda service nova] Creating event network-vif-deleted:cb6c185c-94b9-4994-9bb2-8b68be5d0408 for instance ad149c5f-bf90-41d8-b480-18b9dafbd058 on hv-cinder-82002 Jan 19 16:07:01.490240 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e74340b0-86ec-44ba-9372-c76c277813e8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:01.502077 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-85601a7d-ec9d-4e1a-b240-4d209432ef13 req-98d6ae42-60c2-4173-9929-607c31f97dda service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063839 Jan 19 16:07:01.504875 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 444/828] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:01.516790 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-26b76150-c73f-46a1-bb51-77d1c85e3639 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:01.517560 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-26b76150-c73f-46a1-bb51-77d1c85e3639 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:01.538018 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e74340b0-86ec-44ba-9372-c76c277813e8 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1514 microversion: 2.1 time: 0.798877 Jan 19 16:07:01.538122 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-26b76150-c73f-46a1-bb51-77d1c85e3639 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:01.538211 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 385/829] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:00 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1514 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:07:01.543308 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-26b76150-c73f-46a1-bb51-77d1c85e3639 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:01.544291 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-26b76150-c73f-46a1-bb51-77d1c85e3639 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:01.544752 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-26b76150-c73f-46a1-bb51-77d1c85e3639 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:01.693580 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-26b76150-c73f-46a1-bb51-77d1c85e3639 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:01.702841 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-26b76150-c73f-46a1-bb51-77d1c85e3639 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:01.704446 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-26b76150-c73f-46a1-bb51-77d1c85e3639 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:01.706000 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-26b76150-c73f-46a1-bb51-77d1c85e3639 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1736 microversion: 2.20 time: 0.199739 Jan 19 16:07:01.706851 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 445/830] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:01 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:02.162081 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-b43cf737-c067-4227-a5ad-05131fedf11e tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:02.162757 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-b43cf737-c067-4227-a5ad-05131fedf11e tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 7bc80974-719e-4432-9f6e-2f00a7bf09a3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:02.170087 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b43cf737-c067-4227-a5ad-05131fedf11e tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:02.170825 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b43cf737-c067-4227-a5ad-05131fedf11e tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:02.171597 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b43cf737-c067-4227-a5ad-05131fedf11e tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:02.172094 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b43cf737-c067-4227-a5ad-05131fedf11e tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:02.247437 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-b43cf737-c067-4227-a5ad-05131fedf11e tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:02.255827 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-b43cf737-c067-4227-a5ad-05131fedf11e tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3" status: 200 len: 1276 microversion: 2.1 time: 0.098676 Jan 19 16:07:02.257364 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 386/831] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:02 2022] GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3 => generated 1276 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:07:02.449126 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8850418b-1817-4f15-ab04-748fa4675f7e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:02.449875 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-8850418b-1817-4f15-ab04-748fa4675f7e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:02.457359 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8850418b-1817-4f15-ab04-748fa4675f7e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:02.462911 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8850418b-1817-4f15-ab04-748fa4675f7e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:02.462911 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8850418b-1817-4f15-ab04-748fa4675f7e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:02.462911 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8850418b-1817-4f15-ab04-748fa4675f7e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:02.551493 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d13a4ff5-9e0b-4572-88d3-abf60fd4e22a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:02.552250 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d13a4ff5-9e0b-4572-88d3-abf60fd4e22a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:02.567566 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d13a4ff5-9e0b-4572-88d3-abf60fd4e22a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:02.567566 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d13a4ff5-9e0b-4572-88d3-abf60fd4e22a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:02.567566 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d13a4ff5-9e0b-4572-88d3-abf60fd4e22a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:02.567566 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d13a4ff5-9e0b-4572-88d3-abf60fd4e22a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:02.623508 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d13a4ff5-9e0b-4572-88d3-abf60fd4e22a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:02.625200 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d13a4ff5-9e0b-4572-88d3-abf60fd4e22a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:02.627125 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.objects.instance [None req-d13a4ff5-9e0b-4572-88d3-abf60fd4e22a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lazy-loading 'fault' on Instance uuid ad149c5f-bf90-41d8-b480-18b9dafbd058 {{(pid=128875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:07:02.669423 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8850418b-1817-4f15-ab04-748fa4675f7e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:02.685822 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-8850418b-1817-4f15-ab04-748fa4675f7e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1714 microversion: 2.1 time: 0.240404 Jan 19 16:07:02.699626 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 446/832] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:02 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1714 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:07:02.726417 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ce1c9a69-eccd-454e-806c-768d0703ad36 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:02.728027 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ce1c9a69-eccd-454e-806c-768d0703ad36 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:02.737690 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d13a4ff5-9e0b-4572-88d3-abf60fd4e22a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:02.742577 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ce1c9a69-eccd-454e-806c-768d0703ad36 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:02.743964 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ce1c9a69-eccd-454e-806c-768d0703ad36 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:02.745244 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ce1c9a69-eccd-454e-806c-768d0703ad36 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:02.746024 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ce1c9a69-eccd-454e-806c-768d0703ad36 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:02.752803 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d13a4ff5-9e0b-4572-88d3-abf60fd4e22a tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 200 len: 1307 microversion: 2.1 time: 0.207202 Jan 19 16:07:02.756753 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 387/833] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:02 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 1307 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:07:02.939603 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ce1c9a69-eccd-454e-806c-768d0703ad36 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:02.951450 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ce1c9a69-eccd-454e-806c-768d0703ad36 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:02.953035 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ce1c9a69-eccd-454e-806c-768d0703ad36 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:02.955109 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ce1c9a69-eccd-454e-806c-768d0703ad36 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1736 microversion: 2.20 time: 0.234489 Jan 19 16:07:02.966336 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 447/834] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:02 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1736 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:07:03.277915 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c1aa13ef-8648-4f06-b4d4-a1696b0188c7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:03.279752 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c1aa13ef-8648-4f06-b4d4-a1696b0188c7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 7bc80974-719e-4432-9f6e-2f00a7bf09a3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:03.300994 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c1aa13ef-8648-4f06-b4d4-a1696b0188c7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:03.303535 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c1aa13ef-8648-4f06-b4d4-a1696b0188c7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:03.305460 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c1aa13ef-8648-4f06-b4d4-a1696b0188c7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:03.306427 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c1aa13ef-8648-4f06-b4d4-a1696b0188c7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:03.549907 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c1aa13ef-8648-4f06-b4d4-a1696b0188c7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:03.558529 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c1aa13ef-8648-4f06-b4d4-a1696b0188c7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3" status: 200 len: 1318 microversion: 2.1 time: 0.288187 Jan 19 16:07:03.559051 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 388/835] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:03 2022] GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:07:03.777759 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-17f7277b-1ee2-4985-b07b-fab648c8dbc4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:03.779207 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-17f7277b-1ee2-4985-b07b-fab648c8dbc4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: ad149c5f-bf90-41d8-b480-18b9dafbd058] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:03.786407 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-17f7277b-1ee2-4985-b07b-fab648c8dbc4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:03.786950 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-17f7277b-1ee2-4985-b07b-fab648c8dbc4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:03.787872 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-17f7277b-1ee2-4985-b07b-fab648c8dbc4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:03.788384 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-17f7277b-1ee2-4985-b07b-fab648c8dbc4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:03.803397 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.wsgi [None req-17f7277b-1ee2-4985-b07b-fab648c8dbc4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] HTTP exception thrown: Instance ad149c5f-bf90-41d8-b480-18b9dafbd058 could not be found. Jan 19 16:07:03.804106 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-17f7277b-1ee2-4985-b07b-fab648c8dbc4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Returning 404 to user: Instance ad149c5f-bf90-41d8-b480-18b9dafbd058 could not be found. {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:07:03.805230 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-17f7277b-1ee2-4985-b07b-fab648c8dbc4 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058" status: 404 len: 111 microversion: 2.1 time: 0.033828 Jan 19 16:07:03.805757 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 448/836] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:03 2022] GET /compute/v2.1/servers/ad149c5f-bf90-41d8-b480-18b9dafbd058 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:07:03.814075 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-41743606-88d9-404f-95f8-409c14f95001 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:03.814491 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-41743606-88d9-404f-95f8-409c14f95001 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: 35008211-e55b-4ef3-99d2-36769725e7d7] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:03.820859 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-41743606-88d9-404f-95f8-409c14f95001 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:03.821301 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-41743606-88d9-404f-95f8-409c14f95001 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:03.822091 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-41743606-88d9-404f-95f8-409c14f95001 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:03.822860 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-41743606-88d9-404f-95f8-409c14f95001 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:03.851684 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-41743606-88d9-404f-95f8-409c14f95001 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: 35008211-e55b-4ef3-99d2-36769725e7d7] Going to try to terminate instance {{(pid=128875) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:07:03.973230 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-dce77838-c8d0-42da-8fac-2b11a784a184 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:03.973834 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-dce77838-c8d0-42da-8fac-2b11a784a184 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:03.980042 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dce77838-c8d0-42da-8fac-2b11a784a184 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:03.980485 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dce77838-c8d0-42da-8fac-2b11a784a184 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:03.981278 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dce77838-c8d0-42da-8fac-2b11a784a184 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:03.981712 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dce77838-c8d0-42da-8fac-2b11a784a184 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:04.148151 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-dce77838-c8d0-42da-8fac-2b11a784a184 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:04.156003 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-dce77838-c8d0-42da-8fac-2b11a784a184 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:04.158167 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-dce77838-c8d0-42da-8fac-2b11a784a184 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:04.159495 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-dce77838-c8d0-42da-8fac-2b11a784a184 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1736 microversion: 2.20 time: 0.190613 Jan 19 16:07:04.160055 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 449/837] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:03 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1736 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:07:04.164306 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-d3023e33-b3e9-4eea-908e-af3b61f64b03 req-267a0291-de8c-4627-80da-1a3369881cfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bc80974-719e-4432-9f6e-2f00a7bf09a3", "tag": "c3b0437c-f450-4051-a99a-a5a3ccaab74b"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:07:04.165932 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:07:04.165932 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:07:04.173267 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-d3023e33-b3e9-4eea-908e-af3b61f64b03 req-267a0291-de8c-4627-80da-1a3369881cfe service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:04.173730 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-d3023e33-b3e9-4eea-908e-af3b61f64b03 req-267a0291-de8c-4627-80da-1a3369881cfe service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:04.184976 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-d3023e33-b3e9-4eea-908e-af3b61f64b03 req-267a0291-de8c-4627-80da-1a3369881cfe service nova] Creating event network-changed:c3b0437c-f450-4051-a99a-a5a3ccaab74b for instance 7bc80974-719e-4432-9f6e-2f00a7bf09a3 on hv-cinder-82002 Jan 19 16:07:04.189693 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-d3023e33-b3e9-4eea-908e-af3b61f64b03 req-267a0291-de8c-4627-80da-1a3369881cfe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028532 Jan 19 16:07:04.190290 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 450/838] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:04.220603 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-41743606-88d9-404f-95f8-409c14f95001 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "DELETE /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7" status: 204 len: 0 microversion: 2.1 time: 0.409541 Jan 19 16:07:04.221206 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 389/839] 10.222.0.58 () {58 vars in 1238 bytes} [Wed Jan 19 16:07:03 2022] DELETE /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 19 16:07:04.230086 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-48180540-3b2b-41f8-9bab-a1999fb9e1ae tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:04.230860 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-48180540-3b2b-41f8-9bab-a1999fb9e1ae tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: 35008211-e55b-4ef3-99d2-36769725e7d7] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:04.237709 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-48180540-3b2b-41f8-9bab-a1999fb9e1ae tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:04.238269 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-48180540-3b2b-41f8-9bab-a1999fb9e1ae tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:04.239051 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-48180540-3b2b-41f8-9bab-a1999fb9e1ae tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:04.239755 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-48180540-3b2b-41f8-9bab-a1999fb9e1ae tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:04.384824 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-48180540-3b2b-41f8-9bab-a1999fb9e1ae tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:04.399024 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-48180540-3b2b-41f8-9bab-a1999fb9e1ae tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7" status: 200 len: 1515 microversion: 2.1 time: 0.172620 Jan 19 16:07:04.400443 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 451/840] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:04 2022] GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:07:04.576214 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-4e1f1ab8-ac3a-46a7-acda-7cab7c269cff tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:04.577085 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-4e1f1ab8-ac3a-46a7-acda-7cab7c269cff tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 7bc80974-719e-4432-9f6e-2f00a7bf09a3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:04.583966 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4e1f1ab8-ac3a-46a7-acda-7cab7c269cff tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:04.584607 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4e1f1ab8-ac3a-46a7-acda-7cab7c269cff tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:04.585762 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4e1f1ab8-ac3a-46a7-acda-7cab7c269cff tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:04.586206 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4e1f1ab8-ac3a-46a7-acda-7cab7c269cff tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:04.806365 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-4e1f1ab8-ac3a-46a7-acda-7cab7c269cff tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:04.815296 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-4e1f1ab8-ac3a-46a7-acda-7cab7c269cff tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3" status: 200 len: 1318 microversion: 2.1 time: 0.243283 Jan 19 16:07:04.815883 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 390/841] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:04 2022] GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:07:05.178646 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-1aed5a01-6b51-483f-be38-4f7c2f6aecb4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:05.179229 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-1aed5a01-6b51-483f-be38-4f7c2f6aecb4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:05.185843 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1aed5a01-6b51-483f-be38-4f7c2f6aecb4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:05.186292 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1aed5a01-6b51-483f-be38-4f7c2f6aecb4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:05.187080 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1aed5a01-6b51-483f-be38-4f7c2f6aecb4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:05.187505 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1aed5a01-6b51-483f-be38-4f7c2f6aecb4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:05.326199 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-1aed5a01-6b51-483f-be38-4f7c2f6aecb4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:05.339102 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-1aed5a01-6b51-483f-be38-4f7c2f6aecb4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:05.342022 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-1aed5a01-6b51-483f-be38-4f7c2f6aecb4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:05.343613 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-1aed5a01-6b51-483f-be38-4f7c2f6aecb4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1718 microversion: 2.20 time: 0.169062 Jan 19 16:07:05.344200 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 452/842] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:05 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1718 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:05.416385 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-2f5357bf-8f47-4900-8735-f0ba76cfa7a6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:05.417129 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-2f5357bf-8f47-4900-8735-f0ba76cfa7a6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: 35008211-e55b-4ef3-99d2-36769725e7d7] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:05.423915 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2f5357bf-8f47-4900-8735-f0ba76cfa7a6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:05.424349 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2f5357bf-8f47-4900-8735-f0ba76cfa7a6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:05.425135 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2f5357bf-8f47-4900-8735-f0ba76cfa7a6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:05.425553 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2f5357bf-8f47-4900-8735-f0ba76cfa7a6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:05.833683 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-cdc51c26-2914-425d-9bc8-7127da0ee54f tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:05.834493 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-cdc51c26-2914-425d-9bc8-7127da0ee54f tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 7bc80974-719e-4432-9f6e-2f00a7bf09a3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:05.842130 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cdc51c26-2914-425d-9bc8-7127da0ee54f tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:05.842776 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cdc51c26-2914-425d-9bc8-7127da0ee54f tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:05.843804 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cdc51c26-2914-425d-9bc8-7127da0ee54f tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:05.844881 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cdc51c26-2914-425d-9bc8-7127da0ee54f tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:05.939629 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-2f5357bf-8f47-4900-8735-f0ba76cfa7a6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:05.958271 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-2f5357bf-8f47-4900-8735-f0ba76cfa7a6 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7" status: 200 len: 1515 microversion: 2.1 time: 0.545017 Jan 19 16:07:05.960269 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 391/843] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:05 2022] GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7 => generated 1515 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:07:06.050603 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-cdc51c26-2914-425d-9bc8-7127da0ee54f tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:06.059986 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-cdc51c26-2914-425d-9bc8-7127da0ee54f tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3" status: 200 len: 1318 microversion: 2.1 time: 0.230812 Jan 19 16:07:06.060694 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 453/844] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:05 2022] GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:07:06.362467 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c70cd2f0-2f19-457e-9085-ffa9c22abb28 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:06.363129 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c70cd2f0-2f19-457e-9085-ffa9c22abb28 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:06.372192 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c70cd2f0-2f19-457e-9085-ffa9c22abb28 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:06.372192 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c70cd2f0-2f19-457e-9085-ffa9c22abb28 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:06.372192 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c70cd2f0-2f19-457e-9085-ffa9c22abb28 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:06.372890 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c70cd2f0-2f19-457e-9085-ffa9c22abb28 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:06.643363 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c70cd2f0-2f19-457e-9085-ffa9c22abb28 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:06.653156 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c70cd2f0-2f19-457e-9085-ffa9c22abb28 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:06.654651 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c70cd2f0-2f19-457e-9085-ffa9c22abb28 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:06.655845 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c70cd2f0-2f19-457e-9085-ffa9c22abb28 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1718 microversion: 2.20 time: 0.297278 Jan 19 16:07:06.656689 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 392/845] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:06 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1718 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:06.984075 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-00544b3b-bc40-4f64-9ee9-98678cf87bfe tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:06.985479 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-00544b3b-bc40-4f64-9ee9-98678cf87bfe tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: 35008211-e55b-4ef3-99d2-36769725e7d7] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:06.995751 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-00544b3b-bc40-4f64-9ee9-98678cf87bfe tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:06.996446 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-00544b3b-bc40-4f64-9ee9-98678cf87bfe tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:06.997665 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-00544b3b-bc40-4f64-9ee9-98678cf87bfe tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:06.998253 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-00544b3b-bc40-4f64-9ee9-98678cf87bfe tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:07.077613 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c74f2bb4-8c92-41b9-9f7c-98d98e38a71c tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:07.078409 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c74f2bb4-8c92-41b9-9f7c-98d98e38a71c tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 7bc80974-719e-4432-9f6e-2f00a7bf09a3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:07.089539 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c74f2bb4-8c92-41b9-9f7c-98d98e38a71c tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:07.089970 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c74f2bb4-8c92-41b9-9f7c-98d98e38a71c tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:07.090810 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c74f2bb4-8c92-41b9-9f7c-98d98e38a71c tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:07.096779 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-00544b3b-bc40-4f64-9ee9-98678cf87bfe tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:07.103385 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c74f2bb4-8c92-41b9-9f7c-98d98e38a71c tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:07.112890 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-00544b3b-bc40-4f64-9ee9-98678cf87bfe tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7" status: 200 len: 1473 microversion: 2.1 time: 0.132284 Jan 19 16:07:07.114911 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 454/846] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:06 2022] GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7 => generated 1473 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:07:07.170886 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-4a621d1c-8554-40b7-9e9a-cc2e598a1ef1 req-2e446cc1-a2e9-471c-b5c4-3f8c1ba69d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35008211-e55b-4ef3-99d2-36769725e7d7", "name": "network-vif-deleted", "tag": "558fd963-51da-4461-b393-d0f82483fa47"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:07:07.174839 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:07:07.174839 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:07:07.186111 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-4a621d1c-8554-40b7-9e9a-cc2e598a1ef1 req-2e446cc1-a2e9-471c-b5c4-3f8c1ba69d52 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:07.187135 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-4a621d1c-8554-40b7-9e9a-cc2e598a1ef1 req-2e446cc1-a2e9-471c-b5c4-3f8c1ba69d52 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:07.205789 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-4a621d1c-8554-40b7-9e9a-cc2e598a1ef1 req-2e446cc1-a2e9-471c-b5c4-3f8c1ba69d52 service nova] Creating event network-vif-deleted:558fd963-51da-4461-b393-d0f82483fa47 for instance 35008211-e55b-4ef3-99d2-36769725e7d7 on hv-cinder-82002 Jan 19 16:07:07.213164 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-4a621d1c-8554-40b7-9e9a-cc2e598a1ef1 req-2e446cc1-a2e9-471c-b5c4-3f8c1ba69d52 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051144 Jan 19 16:07:07.214892 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 455/847] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:07.334554 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c74f2bb4-8c92-41b9-9f7c-98d98e38a71c tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:07.348565 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c74f2bb4-8c92-41b9-9f7c-98d98e38a71c tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3" status: 200 len: 1318 microversion: 2.1 time: 0.274271 Jan 19 16:07:07.349655 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 393/848] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:07 2022] GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:07:07.675330 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5b48d82b-c520-4a32-a4d2-1884c790f1fa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:07.676437 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5b48d82b-c520-4a32-a4d2-1884c790f1fa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:07.684251 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5b48d82b-c520-4a32-a4d2-1884c790f1fa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:07.684783 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5b48d82b-c520-4a32-a4d2-1884c790f1fa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:07.685591 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5b48d82b-c520-4a32-a4d2-1884c790f1fa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:07.686773 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5b48d82b-c520-4a32-a4d2-1884c790f1fa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:08.094708 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5b48d82b-c520-4a32-a4d2-1884c790f1fa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:08.104065 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5b48d82b-c520-4a32-a4d2-1884c790f1fa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:08.105589 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5b48d82b-c520-4a32-a4d2-1884c790f1fa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:08.106790 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5b48d82b-c520-4a32-a4d2-1884c790f1fa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1718 microversion: 2.20 time: 0.435919 Jan 19 16:07:08.107527 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 456/849] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:07 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1718 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:07:08.137773 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-621ab450-437a-4576-9f5d-ffd52576ab75 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:08.138388 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-621ab450-437a-4576-9f5d-ffd52576ab75 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: 35008211-e55b-4ef3-99d2-36769725e7d7] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:08.145816 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-621ab450-437a-4576-9f5d-ffd52576ab75 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:08.146197 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-621ab450-437a-4576-9f5d-ffd52576ab75 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:08.147044 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-621ab450-437a-4576-9f5d-ffd52576ab75 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:08.147485 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-621ab450-437a-4576-9f5d-ffd52576ab75 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:08.184159 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-621ab450-437a-4576-9f5d-ffd52576ab75 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:08.184728 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-621ab450-437a-4576-9f5d-ffd52576ab75 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:08.185355 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.objects.instance [None req-621ab450-437a-4576-9f5d-ffd52576ab75 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lazy-loading 'fault' on Instance uuid 35008211-e55b-4ef3-99d2-36769725e7d7 {{(pid=128875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:07:08.227299 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-621ab450-437a-4576-9f5d-ffd52576ab75 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:08.235489 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-621ab450-437a-4576-9f5d-ffd52576ab75 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7" status: 200 len: 1308 microversion: 2.1 time: 0.100923 Jan 19 16:07:08.236089 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 394/850] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:08 2022] GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:07:08.376833 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-847115f8-0669-4b5e-87cb-617cca521ccb tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:08.377952 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-847115f8-0669-4b5e-87cb-617cca521ccb tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 7bc80974-719e-4432-9f6e-2f00a7bf09a3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:08.385289 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-847115f8-0669-4b5e-87cb-617cca521ccb tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:08.385818 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-847115f8-0669-4b5e-87cb-617cca521ccb tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:08.386699 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-847115f8-0669-4b5e-87cb-617cca521ccb tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:08.387239 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-847115f8-0669-4b5e-87cb-617cca521ccb tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:08.573231 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-847115f8-0669-4b5e-87cb-617cca521ccb tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:08.582117 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-847115f8-0669-4b5e-87cb-617cca521ccb tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3" status: 200 len: 1318 microversion: 2.1 time: 0.212481 Jan 19 16:07:08.582758 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 457/851] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:08 2022] GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:07:08.828208 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-60da54bd-a95a-43bc-85f2-2ccfb98f6d64 req-14082200-f9a1-40f3-b265-4eba1778f7ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02ba601a-94e7-486f-9d1b-7418ae534f4f", "name": "network-vif-unplugged", "status": "completed", "tag": "51ed4245-58bf-4cc7-838e-9cad3734639e"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:07:08.833018 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:07:08.833018 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:07:08.850929 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-60da54bd-a95a-43bc-85f2-2ccfb98f6d64 req-14082200-f9a1-40f3-b265-4eba1778f7ed service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:08.851899 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-60da54bd-a95a-43bc-85f2-2ccfb98f6d64 req-14082200-f9a1-40f3-b265-4eba1778f7ed service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:08.878057 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-60da54bd-a95a-43bc-85f2-2ccfb98f6d64 req-14082200-f9a1-40f3-b265-4eba1778f7ed service nova] Creating event network-vif-unplugged:51ed4245-58bf-4cc7-838e-9cad3734639e for instance 02ba601a-94e7-486f-9d1b-7418ae534f4f on hv-cinder-82002 Jan 19 16:07:08.888758 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-60da54bd-a95a-43bc-85f2-2ccfb98f6d64 req-14082200-f9a1-40f3-b265-4eba1778f7ed service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069177 Jan 19 16:07:08.890131 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 395/852] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:09.128067 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-239a85a3-fa78-4de3-b9a8-a6e270149070 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:09.129651 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-239a85a3-fa78-4de3-b9a8-a6e270149070 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:09.136566 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-239a85a3-fa78-4de3-b9a8-a6e270149070 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:09.137152 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-239a85a3-fa78-4de3-b9a8-a6e270149070 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:09.138013 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-239a85a3-fa78-4de3-b9a8-a6e270149070 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:09.138643 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-239a85a3-fa78-4de3-b9a8-a6e270149070 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:09.259545 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-269dc966-735e-4fac-a36c-bccb74a99694 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:09.260233 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-269dc966-735e-4fac-a36c-bccb74a99694 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: 35008211-e55b-4ef3-99d2-36769725e7d7] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:09.268004 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-269dc966-735e-4fac-a36c-bccb74a99694 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:09.269294 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-269dc966-735e-4fac-a36c-bccb74a99694 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:09.270306 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-269dc966-735e-4fac-a36c-bccb74a99694 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:09.270742 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-269dc966-735e-4fac-a36c-bccb74a99694 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:09.288644 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.wsgi [None req-269dc966-735e-4fac-a36c-bccb74a99694 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] HTTP exception thrown: Instance 35008211-e55b-4ef3-99d2-36769725e7d7 could not be found. Jan 19 16:07:09.289446 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-269dc966-735e-4fac-a36c-bccb74a99694 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Returning 404 to user: Instance 35008211-e55b-4ef3-99d2-36769725e7d7 could not be found. {{(pid=128875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:07:09.290366 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-269dc966-735e-4fac-a36c-bccb74a99694 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7" status: 404 len: 111 microversion: 2.1 time: 0.035911 Jan 19 16:07:09.291122 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 396/853] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:09 2022] GET /compute/v2.1/servers/35008211-e55b-4ef3-99d2-36769725e7d7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 16:07:09.292730 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-239a85a3-fa78-4de3-b9a8-a6e270149070 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:09.305437 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-239a85a3-fa78-4de3-b9a8-a6e270149070 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:09.307510 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-239a85a3-fa78-4de3-b9a8-a6e270149070 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:09.309156 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-239a85a3-fa78-4de3-b9a8-a6e270149070 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1721 microversion: 2.20 time: 0.187179 Jan 19 16:07:09.309870 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 458/854] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:09 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:09.333393 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-3d2fd581-843a-4368-a4b2-9642d67c8d84 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3bf21bcd-d09b-4511-9fec-9949f0e3d10a"}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:07:09.335339 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-3d2fd581-843a-4368-a4b2-9642d67c8d84 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:09.346082 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3d2fd581-843a-4368-a4b2-9642d67c8d84 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:09.347074 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3d2fd581-843a-4368-a4b2-9642d67c8d84 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:09.348379 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3d2fd581-843a-4368-a4b2-9642d67c8d84 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:09.349180 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3d2fd581-843a-4368-a4b2-9642d67c8d84 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:09.603689 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-be907821-9373-49b1-acf9-56ce1e66b21d tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:09.604860 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-be907821-9373-49b1-acf9-56ce1e66b21d tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 7bc80974-719e-4432-9f6e-2f00a7bf09a3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:09.615826 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-be907821-9373-49b1-acf9-56ce1e66b21d tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:09.616578 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-be907821-9373-49b1-acf9-56ce1e66b21d tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:09.617647 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-be907821-9373-49b1-acf9-56ce1e66b21d tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:09.618168 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-be907821-9373-49b1-acf9-56ce1e66b21d tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:09.820270 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-be907821-9373-49b1-acf9-56ce1e66b21d tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:09.829688 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-be907821-9373-49b1-acf9-56ce1e66b21d tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3" status: 200 len: 1318 microversion: 2.1 time: 0.233061 Jan 19 16:07:09.830347 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 459/855] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:09 2022] GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:07:10.779865 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-3d2fd581-843a-4368-a4b2-9642d67c8d84 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.453470 Jan 19 16:07:10.789453 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 397/856] 10.222.0.58 () {62 vars in 1363 bytes} [Wed Jan 19 16:07:09 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/os-volume_attachments => generated 188 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:07:10.850327 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c775490a-f754-4ba2-9090-3cf18072fa08 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:10.850907 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c775490a-f754-4ba2-9090-3cf18072fa08 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:10.858172 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c775490a-f754-4ba2-9090-3cf18072fa08 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:10.864110 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-8a265b8c-dddb-4c0d-879f-427af7ac3964 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:10.864735 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8a265b8c-dddb-4c0d-879f-427af7ac3964 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 7bc80974-719e-4432-9f6e-2f00a7bf09a3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:10.868288 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c775490a-f754-4ba2-9090-3cf18072fa08 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:10.869927 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c775490a-f754-4ba2-9090-3cf18072fa08 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:10.873900 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c775490a-f754-4ba2-9090-3cf18072fa08 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:10.877190 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8a265b8c-dddb-4c0d-879f-427af7ac3964 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:10.877952 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8a265b8c-dddb-4c0d-879f-427af7ac3964 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:10.880350 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8a265b8c-dddb-4c0d-879f-427af7ac3964 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:10.882689 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8a265b8c-dddb-4c0d-879f-427af7ac3964 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:10.936664 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c775490a-f754-4ba2-9090-3cf18072fa08 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Going to try to terminate instance {{(pid=128876) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:07:11.069124 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8a265b8c-dddb-4c0d-879f-427af7ac3964 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:11.079804 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-8a265b8c-dddb-4c0d-879f-427af7ac3964 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3" status: 200 len: 1318 microversion: 2.1 time: 0.219522 Jan 19 16:07:11.080455 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 398/857] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:10 2022] GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:07:11.087728 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-1482dd08-34b3-4592-bc6f-5d2ceed16fbe tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:07:11.088304 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-1482dd08-34b3-4592-bc6f-5d2ceed16fbe tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:11.094655 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1482dd08-34b3-4592-bc6f-5d2ceed16fbe tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:11.095131 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1482dd08-34b3-4592-bc6f-5d2ceed16fbe tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:11.095942 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1482dd08-34b3-4592-bc6f-5d2ceed16fbe tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:11.096380 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1482dd08-34b3-4592-bc6f-5d2ceed16fbe tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:11.515901 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-1482dd08-34b3-4592-bc6f-5d2ceed16fbe tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action" status: 202 len: 0 microversion: 2.20 time: 0.434235 Jan 19 16:07:11.519466 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 399/858] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:07:11 2022] POST /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/action => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:07:11.529798 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-badf68c5-c590-402b-9459-1f10e541f8b4 req-5f88404b-7002-4621-80b9-7e6c540964a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc80974-719e-4432-9f6e-2f00a7bf09a3", "name": "network-vif-plugged", "status": "completed", "tag": "c3b0437c-f450-4051-a99a-a5a3ccaab74b"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:07:11.535128 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:07:11.535128 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:07:11.536164 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c775490a-f754-4ba2-9090-3cf18072fa08 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 204 len: 0 microversion: 2.1 time: 0.689426 Jan 19 16:07:11.537666 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 460/859] 10.222.0.58 () {58 vars in 1238 bytes} [Wed Jan 19 16:07:10 2022] DELETE /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 19 16:07:11.544904 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-7a906fdb-ec97-4dd5-8a7f-21ce50e6ab37 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:11.550737 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-7a906fdb-ec97-4dd5-8a7f-21ce50e6ab37 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:11.553438 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7a906fdb-ec97-4dd5-8a7f-21ce50e6ab37 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:11.554285 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7a906fdb-ec97-4dd5-8a7f-21ce50e6ab37 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:11.555163 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7a906fdb-ec97-4dd5-8a7f-21ce50e6ab37 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:11.555748 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7a906fdb-ec97-4dd5-8a7f-21ce50e6ab37 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:11.555998 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-badf68c5-c590-402b-9459-1f10e541f8b4 req-5f88404b-7002-4621-80b9-7e6c540964a6 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:11.556816 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-badf68c5-c590-402b-9459-1f10e541f8b4 req-5f88404b-7002-4621-80b9-7e6c540964a6 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:11.572149 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-badf68c5-c590-402b-9459-1f10e541f8b4 req-5f88404b-7002-4621-80b9-7e6c540964a6 service nova] Creating event network-vif-plugged:c3b0437c-f450-4051-a99a-a5a3ccaab74b for instance 7bc80974-719e-4432-9f6e-2f00a7bf09a3 on hv-cinder-82002 Jan 19 16:07:11.577397 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-badf68c5-c590-402b-9459-1f10e541f8b4 req-5f88404b-7002-4621-80b9-7e6c540964a6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054750 Jan 19 16:07:11.584977 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 400/860] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:11.584977 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-01102919-4603-492e-87ba-3066ec477331 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:11.584977 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-01102919-4603-492e-87ba-3066ec477331 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:11.591975 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-01102919-4603-492e-87ba-3066ec477331 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:11.592339 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-01102919-4603-492e-87ba-3066ec477331 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:11.593395 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-01102919-4603-492e-87ba-3066ec477331 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:11.593996 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-01102919-4603-492e-87ba-3066ec477331 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:11.786368 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-7a906fdb-ec97-4dd5-8a7f-21ce50e6ab37 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:11.807080 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-01102919-4603-492e-87ba-3066ec477331 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:11.810771 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-7a906fdb-ec97-4dd5-8a7f-21ce50e6ab37 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:11.812401 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-7a906fdb-ec97-4dd5-8a7f-21ce50e6ab37 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:11.813930 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-7a906fdb-ec97-4dd5-8a7f-21ce50e6ab37 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1747 microversion: 2.20 time: 0.274431 Jan 19 16:07:11.814681 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 461/861] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:11 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1747 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:11.815961 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-01102919-4603-492e-87ba-3066ec477331 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1512 microversion: 2.1 time: 0.236469 Jan 19 16:07:11.816816 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 401/862] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:11 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1512 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:07:12.100490 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f7eb0dd7-6465-4cf0-8878-a538d67e05d2 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:12.101195 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-f7eb0dd7-6465-4cf0-8878-a538d67e05d2 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 7bc80974-719e-4432-9f6e-2f00a7bf09a3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:12.107514 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f7eb0dd7-6465-4cf0-8878-a538d67e05d2 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:12.107976 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f7eb0dd7-6465-4cf0-8878-a538d67e05d2 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:12.109031 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f7eb0dd7-6465-4cf0-8878-a538d67e05d2 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:12.109469 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f7eb0dd7-6465-4cf0-8878-a538d67e05d2 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:12.258461 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-f7eb0dd7-6465-4cf0-8878-a538d67e05d2 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:12.267541 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f7eb0dd7-6465-4cf0-8878-a538d67e05d2 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3" status: 200 len: 1318 microversion: 2.1 time: 0.171355 Jan 19 16:07:12.268130 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 402/863] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:12 2022] GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:07:12.833287 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-cbba4a15-402d-49a5-8028-d9a5e9ddc772 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:12.834548 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-cbba4a15-402d-49a5-8028-d9a5e9ddc772 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:12.838442 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-19e8715b-8556-483b-a9db-0279135243fd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:12.839584 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-19e8715b-8556-483b-a9db-0279135243fd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:12.841187 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cbba4a15-402d-49a5-8028-d9a5e9ddc772 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:12.841666 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cbba4a15-402d-49a5-8028-d9a5e9ddc772 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:12.842408 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cbba4a15-402d-49a5-8028-d9a5e9ddc772 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:12.842832 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cbba4a15-402d-49a5-8028-d9a5e9ddc772 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:12.847713 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-19e8715b-8556-483b-a9db-0279135243fd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:12.848462 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-19e8715b-8556-483b-a9db-0279135243fd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:12.849527 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-19e8715b-8556-483b-a9db-0279135243fd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:12.850085 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-19e8715b-8556-483b-a9db-0279135243fd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:13.022042 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-cbba4a15-402d-49a5-8028-d9a5e9ddc772 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:13.030913 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-cbba4a15-402d-49a5-8028-d9a5e9ddc772 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:13.032810 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-cbba4a15-402d-49a5-8028-d9a5e9ddc772 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:13.034078 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-cbba4a15-402d-49a5-8028-d9a5e9ddc772 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1747 microversion: 2.20 time: 0.205065 Jan 19 16:07:13.036414 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 462/864] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:12 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1747 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:07:13.045147 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-19e8715b-8556-483b-a9db-0279135243fd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:13.050283 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-19e8715b-8556-483b-a9db-0279135243fd tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1512 microversion: 2.1 time: 0.219401 Jan 19 16:07:13.055427 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 403/865] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:12 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1512 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:07:13.284778 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-924eaa90-63d1-436b-b04d-73cca0ca2d4b tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:13.285490 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-924eaa90-63d1-436b-b04d-73cca0ca2d4b tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 7bc80974-719e-4432-9f6e-2f00a7bf09a3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:13.296985 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-924eaa90-63d1-436b-b04d-73cca0ca2d4b tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:13.298184 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-924eaa90-63d1-436b-b04d-73cca0ca2d4b tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:13.299030 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-924eaa90-63d1-436b-b04d-73cca0ca2d4b tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:13.299641 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-924eaa90-63d1-436b-b04d-73cca0ca2d4b tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:13.477435 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-924eaa90-63d1-436b-b04d-73cca0ca2d4b tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:13.486408 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-924eaa90-63d1-436b-b04d-73cca0ca2d4b tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3" status: 200 len: 1318 microversion: 2.1 time: 0.205960 Jan 19 16:07:13.487056 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 463/866] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:13 2022] GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:07:14.068015 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-8f9496dc-0979-440c-b200-005f35bfffd3 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:14.068698 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8f9496dc-0979-440c-b200-005f35bfffd3 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:14.069542 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e005c815-3e55-48f7-9b92-01323d514ef9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:14.070522 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-e005c815-3e55-48f7-9b92-01323d514ef9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:14.075616 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8f9496dc-0979-440c-b200-005f35bfffd3 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:14.076272 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8f9496dc-0979-440c-b200-005f35bfffd3 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:14.076514 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e005c815-3e55-48f7-9b92-01323d514ef9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:14.077065 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8f9496dc-0979-440c-b200-005f35bfffd3 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:14.077319 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e005c815-3e55-48f7-9b92-01323d514ef9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:14.077597 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8f9496dc-0979-440c-b200-005f35bfffd3 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:14.079163 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e005c815-3e55-48f7-9b92-01323d514ef9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:14.079761 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e005c815-3e55-48f7-9b92-01323d514ef9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:14.270167 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e005c815-3e55-48f7-9b92-01323d514ef9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:14.279157 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e005c815-3e55-48f7-9b92-01323d514ef9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:14.280722 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e005c815-3e55-48f7-9b92-01323d514ef9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:14.281979 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e005c815-3e55-48f7-9b92-01323d514ef9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1749 microversion: 2.20 time: 0.216206 Jan 19 16:07:14.282544 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 464/867] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:14 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1749 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:07:14.348121 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8f9496dc-0979-440c-b200-005f35bfffd3 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:14.355827 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-8f9496dc-0979-440c-b200-005f35bfffd3 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1512 microversion: 2.1 time: 0.291600 Jan 19 16:07:14.356428 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 404/868] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:14 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1512 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:07:14.506048 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-7e39b7fb-36b5-4a63-b61f-c6d0dbcf8afd tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:14.506645 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-7e39b7fb-36b5-4a63-b61f-c6d0dbcf8afd tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 7bc80974-719e-4432-9f6e-2f00a7bf09a3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:14.513192 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7e39b7fb-36b5-4a63-b61f-c6d0dbcf8afd tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:14.515336 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7e39b7fb-36b5-4a63-b61f-c6d0dbcf8afd tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:14.516401 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7e39b7fb-36b5-4a63-b61f-c6d0dbcf8afd tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:14.517086 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7e39b7fb-36b5-4a63-b61f-c6d0dbcf8afd tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:14.604092 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-5edae367-876a-4471-bcfd-d93d1ad0f739 req-38c70595-b209-482b-ba0b-92f427cb6a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf8c20cd-e1b6-415c-9811-c58dbcf31b49", "name": "network-vif-deleted", "tag": "eccf3abd-c626-40ae-a8b0-a9dcdf81545f"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:07:14.606743 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:07:14.606743 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:07:14.617526 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-5edae367-876a-4471-bcfd-d93d1ad0f739 req-38c70595-b209-482b-ba0b-92f427cb6a73 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:14.618739 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-5edae367-876a-4471-bcfd-d93d1ad0f739 req-38c70595-b209-482b-ba0b-92f427cb6a73 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:14.634317 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-5edae367-876a-4471-bcfd-d93d1ad0f739 req-38c70595-b209-482b-ba0b-92f427cb6a73 service nova] Creating event network-vif-deleted:eccf3abd-c626-40ae-a8b0-a9dcdf81545f for instance cf8c20cd-e1b6-415c-9811-c58dbcf31b49 on hv-cinder-82002 Jan 19 16:07:14.639500 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-5edae367-876a-4471-bcfd-d93d1ad0f739 req-38c70595-b209-482b-ba0b-92f427cb6a73 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040696 Jan 19 16:07:14.640076 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 405/869] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:14.705174 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-7e39b7fb-36b5-4a63-b61f-c6d0dbcf8afd tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:14.712937 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-7e39b7fb-36b5-4a63-b61f-c6d0dbcf8afd tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3" status: 200 len: 1505 microversion: 2.1 time: 0.211011 Jan 19 16:07:14.713847 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 465/870] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:14 2022] GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3 => generated 1505 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:07:14.730247 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-a57900b7-6f1c-4419-a056-a0754edfa0b7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "435a31f7-ae71-43c7-bf39-41c7017a5fe1", "device": "/dev/sdb"}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:07:14.731902 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-a57900b7-6f1c-4419-a056-a0754edfa0b7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 7bc80974-719e-4432-9f6e-2f00a7bf09a3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:14.738636 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a57900b7-6f1c-4419-a056-a0754edfa0b7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:14.739116 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a57900b7-6f1c-4419-a056-a0754edfa0b7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:14.739899 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a57900b7-6f1c-4419-a056-a0754edfa0b7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:14.740324 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a57900b7-6f1c-4419-a056-a0754edfa0b7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:15.301684 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8a3493ac-8480-4a34-9e6a-fdf9d238f472 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:15.302314 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-8a3493ac-8480-4a34-9e6a-fdf9d238f472 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:15.309314 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8a3493ac-8480-4a34-9e6a-fdf9d238f472 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:15.309756 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8a3493ac-8480-4a34-9e6a-fdf9d238f472 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:15.310535 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8a3493ac-8480-4a34-9e6a-fdf9d238f472 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:15.310959 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8a3493ac-8480-4a34-9e6a-fdf9d238f472 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:15.490467 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8a3493ac-8480-4a34-9e6a-fdf9d238f472 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:15.501698 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8a3493ac-8480-4a34-9e6a-fdf9d238f472 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:15.503247 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8a3493ac-8480-4a34-9e6a-fdf9d238f472 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:15.504429 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-8a3493ac-8480-4a34-9e6a-fdf9d238f472 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.207042 Jan 19 16:07:15.505003 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 466/871] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:15 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:07:15.510619 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-4c89ffa6-103e-4b87-9199-a2a256beac85 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:15.511251 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-4c89ffa6-103e-4b87-9199-a2a256beac85 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:15.517900 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4c89ffa6-103e-4b87-9199-a2a256beac85 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:15.518341 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4c89ffa6-103e-4b87-9199-a2a256beac85 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:15.519359 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4c89ffa6-103e-4b87-9199-a2a256beac85 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:15.519791 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4c89ffa6-103e-4b87-9199-a2a256beac85 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:15.554278 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4c89ffa6-103e-4b87-9199-a2a256beac85 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:15.554722 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4c89ffa6-103e-4b87-9199-a2a256beac85 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:15.555210 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.objects.instance [None req-4c89ffa6-103e-4b87-9199-a2a256beac85 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lazy-loading 'fault' on Instance uuid cf8c20cd-e1b6-415c-9811-c58dbcf31b49 {{(pid=128876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:07:15.620488 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-4c89ffa6-103e-4b87-9199-a2a256beac85 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ace876fa34fe688d055a4a5fb1fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e40e4efd974d37820bb6724978d22f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:15.628587 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-4c89ffa6-103e-4b87-9199-a2a256beac85 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 200 len: 1306 microversion: 2.1 time: 0.121755 Jan 19 16:07:15.629562 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 467/872] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:15 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 1306 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:07:15.779383 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-a57900b7-6f1c-4419-a056-a0754edfa0b7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "POST /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.052945 Jan 19 16:07:15.785585 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 406/873] 10.222.0.58 () {60 vars in 1322 bytes} [Wed Jan 19 16:07:14 2022] POST /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3/os-volume_attachments => generated 194 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:16.523160 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f3d07ed4-4b7e-4654-b3f0-3c95e5f12a61 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:16.523767 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f3d07ed4-4b7e-4654-b3f0-3c95e5f12a61 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:16.530440 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f3d07ed4-4b7e-4654-b3f0-3c95e5f12a61 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:16.530883 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f3d07ed4-4b7e-4654-b3f0-3c95e5f12a61 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:16.531770 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f3d07ed4-4b7e-4654-b3f0-3c95e5f12a61 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:16.532372 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f3d07ed4-4b7e-4654-b3f0-3c95e5f12a61 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:16.656234 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c7b47b3e-e64e-46bd-9803-f9bba7b23de7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:16.657211 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c7b47b3e-e64e-46bd-9803-f9bba7b23de7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] [instance: cf8c20cd-e1b6-415c-9811-c58dbcf31b49] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:16.664794 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c7b47b3e-e64e-46bd-9803-f9bba7b23de7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:16.668522 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c7b47b3e-e64e-46bd-9803-f9bba7b23de7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:16.668522 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c7b47b3e-e64e-46bd-9803-f9bba7b23de7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:16.668522 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c7b47b3e-e64e-46bd-9803-f9bba7b23de7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:16.683323 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.wsgi [None req-c7b47b3e-e64e-46bd-9803-f9bba7b23de7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] HTTP exception thrown: Instance cf8c20cd-e1b6-415c-9811-c58dbcf31b49 could not be found. Jan 19 16:07:16.683968 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c7b47b3e-e64e-46bd-9803-f9bba7b23de7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] Returning 404 to user: Instance cf8c20cd-e1b6-415c-9811-c58dbcf31b49 could not be found. {{(pid=128875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:07:16.684823 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c7b47b3e-e64e-46bd-9803-f9bba7b23de7 tempest-AttachVolumeNegativeTest-1082942681 tempest-AttachVolumeNegativeTest-1082942681-project] 10.222.0.58 "GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49" status: 404 len: 111 microversion: 2.1 time: 0.034724 Jan 19 16:07:16.685388 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 407/874] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:07:16 2022] GET /compute/v2.1/servers/cf8c20cd-e1b6-415c-9811-c58dbcf31b49 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:07:16.685846 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f3d07ed4-4b7e-4654-b3f0-3c95e5f12a61 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:16.698666 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f3d07ed4-4b7e-4654-b3f0-3c95e5f12a61 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:16.700594 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f3d07ed4-4b7e-4654-b3f0-3c95e5f12a61 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:16.701884 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f3d07ed4-4b7e-4654-b3f0-3c95e5f12a61 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.183079 Jan 19 16:07:16.702832 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 468/875] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:16 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:17.721279 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-94185d76-089b-46a8-86c3-d460367764e1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:17.722532 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-94185d76-089b-46a8-86c3-d460367764e1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:17.729639 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-94185d76-089b-46a8-86c3-d460367764e1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:17.730682 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-94185d76-089b-46a8-86c3-d460367764e1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:17.731845 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-94185d76-089b-46a8-86c3-d460367764e1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:17.732504 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-94185d76-089b-46a8-86c3-d460367764e1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:17.946931 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-94185d76-089b-46a8-86c3-d460367764e1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:17.958477 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-94185d76-089b-46a8-86c3-d460367764e1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:17.960728 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-94185d76-089b-46a8-86c3-d460367764e1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:17.962129 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-94185d76-089b-46a8-86c3-d460367764e1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.245063 Jan 19 16:07:17.968513 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 408/876] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:17 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:07:18.981348 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-6fb11fcf-aa81-4efd-927b-d70fcb8ad55a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:18.981960 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-6fb11fcf-aa81-4efd-927b-d70fcb8ad55a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:18.990336 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6fb11fcf-aa81-4efd-927b-d70fcb8ad55a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:18.990786 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6fb11fcf-aa81-4efd-927b-d70fcb8ad55a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:18.991606 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6fb11fcf-aa81-4efd-927b-d70fcb8ad55a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:18.992029 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6fb11fcf-aa81-4efd-927b-d70fcb8ad55a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:19.212352 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-6fb11fcf-aa81-4efd-927b-d70fcb8ad55a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:19.221603 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-6fb11fcf-aa81-4efd-927b-d70fcb8ad55a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:19.223147 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-6fb11fcf-aa81-4efd-927b-d70fcb8ad55a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:19.224334 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-6fb11fcf-aa81-4efd-927b-d70fcb8ad55a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.247732 Jan 19 16:07:19.224909 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 469/877] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:18 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:19.903033 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6d5f6641-1116-4279-ae6a-09b4a1bcf96e tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Action: 'create', calling method: .version_select at 0x7feff515ab80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1778813392"}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:07:20.245656 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-de1c95a9-0986-4eb0-bb53-5e022b4c5d9e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:20.246600 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-de1c95a9-0986-4eb0-bb53-5e022b4c5d9e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:20.254249 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-de1c95a9-0986-4eb0-bb53-5e022b4c5d9e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:20.254696 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-de1c95a9-0986-4eb0-bb53-5e022b4c5d9e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:20.255531 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-de1c95a9-0986-4eb0-bb53-5e022b4c5d9e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:20.255971 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-de1c95a9-0986-4eb0-bb53-5e022b4c5d9e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:20.441838 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-de1c95a9-0986-4eb0-bb53-5e022b4c5d9e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:20.449666 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-de1c95a9-0986-4eb0-bb53-5e022b4c5d9e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:20.451256 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-de1c95a9-0986-4eb0-bb53-5e022b4c5d9e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:20.452441 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-de1c95a9-0986-4eb0-bb53-5e022b4c5d9e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.212484 Jan 19 16:07:20.453015 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 470/878] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:20 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:21.169383 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6d5f6641-1116-4279-ae6a-09b4a1bcf96e tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.407801 Jan 19 16:07:21.170313 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 409/879] 10.222.0.58 () {60 vars in 1154 bytes} [Wed Jan 19 16:07:19 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1409 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 19 16:07:21.182248 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-9204ff76-2c1c-4ffa-94ce-f849a2c91fe4 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff510e040>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:21.248869 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-9204ff76-2c1c-4ffa-94ce-f849a2c91fe4 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf" status: 200 len: 345 microversion: 2.1 time: 0.070960 Jan 19 16:07:21.252752 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 471/880] 10.222.0.58 () {58 vars in 1244 bytes} [Wed Jan 19 16:07:21 2022] GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:21.473627 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-45d377d8-19af-4340-89a5-3b0c9e71b276 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:21.473627 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-45d377d8-19af-4340-89a5-3b0c9e71b276 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:21.478995 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-45d377d8-19af-4340-89a5-3b0c9e71b276 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:21.479487 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-45d377d8-19af-4340-89a5-3b0c9e71b276 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:21.480294 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-45d377d8-19af-4340-89a5-3b0c9e71b276 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:21.480732 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-45d377d8-19af-4340-89a5-3b0c9e71b276 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:21.641482 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-45d377d8-19af-4340-89a5-3b0c9e71b276 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:21.659206 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-45d377d8-19af-4340-89a5-3b0c9e71b276 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:21.659608 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-45d377d8-19af-4340-89a5-3b0c9e71b276 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:21.661875 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-45d377d8-19af-4340-89a5-3b0c9e71b276 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.193998 Jan 19 16:07:21.662925 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 410/881] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:21 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:22.262409 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-be1ea3a5-fe8a-43cd-a160-1276226ca663 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff5432670>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:22.524242 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-be1ea3a5-fe8a-43cd-a160-1276226ca663 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf" status: 200 len: 345 microversion: 2.1 time: 0.265828 Jan 19 16:07:22.525663 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 472/882] 10.222.0.58 () {58 vars in 1244 bytes} [Wed Jan 19 16:07:22 2022] GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf => generated 345 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:22.685429 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-8cbd9e5b-b6a9-4f28-9164-3d7b15d4efa7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:22.686592 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8cbd9e5b-b6a9-4f28-9164-3d7b15d4efa7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:22.704215 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8cbd9e5b-b6a9-4f28-9164-3d7b15d4efa7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:22.704215 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8cbd9e5b-b6a9-4f28-9164-3d7b15d4efa7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:22.705452 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8cbd9e5b-b6a9-4f28-9164-3d7b15d4efa7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:22.706679 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8cbd9e5b-b6a9-4f28-9164-3d7b15d4efa7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:23.099224 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8cbd9e5b-b6a9-4f28-9164-3d7b15d4efa7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:23.108783 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8cbd9e5b-b6a9-4f28-9164-3d7b15d4efa7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:23.117236 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8cbd9e5b-b6a9-4f28-9164-3d7b15d4efa7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:23.119092 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-8cbd9e5b-b6a9-4f28-9164-3d7b15d4efa7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.440912 Jan 19 16:07:23.119986 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 411/883] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:22 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:23.538196 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-70faa2f2-2507-48d3-a1ab-f351b204da53 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff5111ee0>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:23.598842 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-70faa2f2-2507-48d3-a1ab-f351b204da53 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf" status: 200 len: 346 microversion: 2.1 time: 0.064820 Jan 19 16:07:23.599915 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 473/884] 10.222.0.58 () {58 vars in 1244 bytes} [Wed Jan 19 16:07:23 2022] GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf => generated 346 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:23.612449 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-fcd722d8-9b89-4b04-9e52-11038627fb1d tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Action: 'create', calling method: .version_select at 0x7feff50a7700>, body: {"snapshot": {"volume_id": "60f8dd4f-2123-4c71-9308-06eef11a6baf", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1709280240"}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:07:24.113596 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-fcd722d8-9b89-4b04-9e52-11038627fb1d tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.505591 Jan 19 16:07:24.114204 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 412/885] 10.222.0.58 () {60 vars in 1161 bytes} [Wed Jan 19 16:07:23 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:24.126938 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ee9bf8a5-87b0-43fb-9715-2b61acbe9cb2 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff5111430>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:24.137822 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-8eb598cb-3d45-4e9a-acaa-8e7c77be4ec4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:24.138430 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8eb598cb-3d45-4e9a-acaa-8e7c77be4ec4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:24.148917 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8eb598cb-3d45-4e9a-acaa-8e7c77be4ec4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:24.149397 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8eb598cb-3d45-4e9a-acaa-8e7c77be4ec4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:24.150316 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8eb598cb-3d45-4e9a-acaa-8e7c77be4ec4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:24.150748 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8eb598cb-3d45-4e9a-acaa-8e7c77be4ec4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:24.163546 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ee9bf8a5-87b0-43fb-9715-2b61acbe9cb2 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c" status: 200 len: 287 microversion: 2.1 time: 0.042852 Jan 19 16:07:24.164787 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 474/886] 10.222.0.58 () {58 vars in 1250 bytes} [Wed Jan 19 16:07:24 2022] GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:24.176231 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-667dc943-e0f4-4e37-87c8-f3ca63d20176 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff510e3a0>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:24.216077 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-667dc943-e0f4-4e37-87c8-f3ca63d20176 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.045327 Jan 19 16:07:24.216911 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 475/887] 10.222.0.58 () {58 vars in 1139 bytes} [Wed Jan 19 16:07:24 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:24.228137 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3eba913c-69dc-4f8f-93db-126dd54385e3 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff51f3b80>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:24.279664 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3eba913c-69dc-4f8f-93db-126dd54385e3 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c" status: 200 len: 287 microversion: 2.1 time: 0.055154 Jan 19 16:07:24.282890 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 476/888] 10.222.0.58 () {58 vars in 1250 bytes} [Wed Jan 19 16:07:24 2022] GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:24.343540 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8eb598cb-3d45-4e9a-acaa-8e7c77be4ec4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:24.353018 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8eb598cb-3d45-4e9a-acaa-8e7c77be4ec4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:24.357518 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8eb598cb-3d45-4e9a-acaa-8e7c77be4ec4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:24.357518 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-8eb598cb-3d45-4e9a-acaa-8e7c77be4ec4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.221844 Jan 19 16:07:24.357518 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 413/889] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:24 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:07:25.292582 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8477a3c1-eb4c-4ff9-838f-5f82c369f410 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff50ec700>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:25.330033 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-8477a3c1-eb4c-4ff9-838f-5f82c369f410 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c" status: 200 len: 287 microversion: 2.1 time: 0.041905 Jan 19 16:07:25.330625 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 477/890] 10.222.0.58 () {58 vars in 1250 bytes} [Wed Jan 19 16:07:25 2022] GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:07:25.374747 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-475e775c-bf1e-42cb-b821-9e65ecfbeb60 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:25.376167 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-475e775c-bf1e-42cb-b821-9e65ecfbeb60 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:25.382695 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-475e775c-bf1e-42cb-b821-9e65ecfbeb60 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:25.383190 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-475e775c-bf1e-42cb-b821-9e65ecfbeb60 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:25.384018 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-475e775c-bf1e-42cb-b821-9e65ecfbeb60 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:25.384451 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-475e775c-bf1e-42cb-b821-9e65ecfbeb60 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:25.545219 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-475e775c-bf1e-42cb-b821-9e65ecfbeb60 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:25.555412 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-475e775c-bf1e-42cb-b821-9e65ecfbeb60 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:25.557039 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-475e775c-bf1e-42cb-b821-9e65ecfbeb60 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:25.558241 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-475e775c-bf1e-42cb-b821-9e65ecfbeb60 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.188104 Jan 19 16:07:25.559138 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 414/891] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:25 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:26.345404 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-6a4f42ae-c343-466b-9e3c-6a7c98e7a68c tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff51114c0>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:26.374265 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-6a4f42ae-c343-466b-9e3c-6a7c98e7a68c tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c" status: 200 len: 287 microversion: 2.1 time: 0.033773 Jan 19 16:07:26.374841 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 478/892] 10.222.0.58 () {58 vars in 1250 bytes} [Wed Jan 19 16:07:26 2022] GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:26.578476 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-8e9c4113-48b6-4725-8910-b4b9216b4870 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:26.579108 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8e9c4113-48b6-4725-8910-b4b9216b4870 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:26.585461 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8e9c4113-48b6-4725-8910-b4b9216b4870 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:26.585907 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8e9c4113-48b6-4725-8910-b4b9216b4870 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:26.586684 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8e9c4113-48b6-4725-8910-b4b9216b4870 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:26.587262 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8e9c4113-48b6-4725-8910-b4b9216b4870 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:26.721836 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8e9c4113-48b6-4725-8910-b4b9216b4870 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:26.730369 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8e9c4113-48b6-4725-8910-b4b9216b4870 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:26.731930 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8e9c4113-48b6-4725-8910-b4b9216b4870 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:26.733115 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-8e9c4113-48b6-4725-8910-b4b9216b4870 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.159689 Jan 19 16:07:26.733677 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 415/893] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:26 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:27.386035 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c5c7fd78-6a94-41f3-81c0-4d83fde5e32f tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff51f3dc0>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:27.417159 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c5c7fd78-6a94-41f3-81c0-4d83fde5e32f tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c" status: 200 len: 287 microversion: 2.1 time: 0.035197 Jan 19 16:07:27.417734 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 479/894] 10.222.0.58 () {58 vars in 1250 bytes} [Wed Jan 19 16:07:27 2022] GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:27.751843 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c2864fec-6d19-48a8-b8c8-4830787f6c0b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:27.752435 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c2864fec-6d19-48a8-b8c8-4830787f6c0b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:27.758775 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c2864fec-6d19-48a8-b8c8-4830787f6c0b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:27.759253 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c2864fec-6d19-48a8-b8c8-4830787f6c0b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:27.760029 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c2864fec-6d19-48a8-b8c8-4830787f6c0b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:27.760458 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c2864fec-6d19-48a8-b8c8-4830787f6c0b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:27.889173 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c2864fec-6d19-48a8-b8c8-4830787f6c0b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:27.897488 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c2864fec-6d19-48a8-b8c8-4830787f6c0b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:27.899009 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c2864fec-6d19-48a8-b8c8-4830787f6c0b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:27.900185 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c2864fec-6d19-48a8-b8c8-4830787f6c0b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.152719 Jan 19 16:07:27.900744 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 416/895] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:27 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:28.429531 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3bd36f7f-e9ad-43ae-98b5-e1196441896d tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff50e48b0>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:28.457729 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3bd36f7f-e9ad-43ae-98b5-e1196441896d tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c" status: 200 len: 287 microversion: 2.1 time: 0.032681 Jan 19 16:07:28.458332 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 480/896] 10.222.0.58 () {58 vars in 1250 bytes} [Wed Jan 19 16:07:28 2022] GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:28.917563 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d81b7424-f095-4fec-a2eb-1e65344031fa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:28.918188 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d81b7424-f095-4fec-a2eb-1e65344031fa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:28.925428 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d81b7424-f095-4fec-a2eb-1e65344031fa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:28.925870 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d81b7424-f095-4fec-a2eb-1e65344031fa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:28.926664 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d81b7424-f095-4fec-a2eb-1e65344031fa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:28.927123 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d81b7424-f095-4fec-a2eb-1e65344031fa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:29.073718 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d81b7424-f095-4fec-a2eb-1e65344031fa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:29.083021 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d81b7424-f095-4fec-a2eb-1e65344031fa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:29.084549 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d81b7424-f095-4fec-a2eb-1e65344031fa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:29.085730 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d81b7424-f095-4fec-a2eb-1e65344031fa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.171887 Jan 19 16:07:29.086290 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 417/897] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:28 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:29.473780 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-fa0c030f-4405-4906-b175-dd63e3542a5d tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff5117430>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:29.533747 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-fa0c030f-4405-4906-b175-dd63e3542a5d tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c" status: 200 len: 287 microversion: 2.1 time: 0.067085 Jan 19 16:07:29.534423 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 481/898] 10.222.0.58 () {58 vars in 1250 bytes} [Wed Jan 19 16:07:29 2022] GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:07:30.105331 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-5f8a936e-9872-4a89-8574-a5c8a3fff7ad tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:30.105987 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-5f8a936e-9872-4a89-8574-a5c8a3fff7ad tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:30.116455 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5f8a936e-9872-4a89-8574-a5c8a3fff7ad tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:30.116908 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5f8a936e-9872-4a89-8574-a5c8a3fff7ad tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:30.117701 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5f8a936e-9872-4a89-8574-a5c8a3fff7ad tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:30.118126 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5f8a936e-9872-4a89-8574-a5c8a3fff7ad tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:30.251210 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-5f8a936e-9872-4a89-8574-a5c8a3fff7ad tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:30.259405 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-5f8a936e-9872-4a89-8574-a5c8a3fff7ad tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:30.260896 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-5f8a936e-9872-4a89-8574-a5c8a3fff7ad tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:30.262038 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-5f8a936e-9872-4a89-8574-a5c8a3fff7ad tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.160954 Jan 19 16:07:30.262585 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 418/899] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:30 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:30.545404 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:07:30.545628 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: Wed Jan 19 16:07:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 16:07:30.546202 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-752d695e-fe36-4089-8705-8e151c85e551 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff5111550>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:30.575244 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-752d695e-fe36-4089-8705-8e151c85e551 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c" status: 200 len: 287 microversion: 2.1 time: 0.033053 Jan 19 16:07:30.575828 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 482/900] 10.222.0.58 () {58 vars in 1250 bytes} [Wed Jan 19 16:07:30 2022] GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:07:31.280825 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-4c6a77de-2f1c-414e-b53f-bdd578f24287 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:31.282799 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-4c6a77de-2f1c-414e-b53f-bdd578f24287 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:31.289277 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4c6a77de-2f1c-414e-b53f-bdd578f24287 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:31.289807 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4c6a77de-2f1c-414e-b53f-bdd578f24287 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:31.291723 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4c6a77de-2f1c-414e-b53f-bdd578f24287 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:31.292558 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4c6a77de-2f1c-414e-b53f-bdd578f24287 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:31.440158 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-4c6a77de-2f1c-414e-b53f-bdd578f24287 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:31.448981 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-4c6a77de-2f1c-414e-b53f-bdd578f24287 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:31.450518 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-4c6a77de-2f1c-414e-b53f-bdd578f24287 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:31.451743 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-4c6a77de-2f1c-414e-b53f-bdd578f24287 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.174725 Jan 19 16:07:31.452315 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 419/901] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:31 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:31.587753 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-54a0ddf1-8307-437c-8dcf-ab05e41c1d32 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff53e1dc0>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:31.623999 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-54a0ddf1-8307-437c-8dcf-ab05e41c1d32 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c" status: 200 len: 287 microversion: 2.1 time: 0.033257 Jan 19 16:07:31.623999 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 483/902] 10.222.0.58 () {58 vars in 1250 bytes} [Wed Jan 19 16:07:31 2022] GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:32.470573 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-3515783a-d9a2-452c-b325-da0c321adcbd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:32.471215 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-3515783a-d9a2-452c-b325-da0c321adcbd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:32.477785 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3515783a-d9a2-452c-b325-da0c321adcbd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:32.478222 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3515783a-d9a2-452c-b325-da0c321adcbd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:32.479040 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3515783a-d9a2-452c-b325-da0c321adcbd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:32.479474 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3515783a-d9a2-452c-b325-da0c321adcbd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:32.617104 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-3515783a-d9a2-452c-b325-da0c321adcbd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:32.628730 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-3515783a-d9a2-452c-b325-da0c321adcbd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:32.631423 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e4ec5b64-da5e-4bd7-9fad-6e9e67113179 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff50ec790>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:32.633361 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-3515783a-d9a2-452c-b325-da0c321adcbd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:32.633361 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-3515783a-d9a2-452c-b325-da0c321adcbd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.164700 Jan 19 16:07:32.633361 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 420/903] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:32 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:32.659403 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e4ec5b64-da5e-4bd7-9fad-6e9e67113179 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c" status: 200 len: 287 microversion: 2.1 time: 0.033944 Jan 19 16:07:32.659983 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 484/904] 10.222.0.58 () {58 vars in 1250 bytes} [Wed Jan 19 16:07:32 2022] GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:07:33.650458 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-83ff7c5f-b8d2-4720-a284-74ee0595af4e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:33.651135 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-83ff7c5f-b8d2-4720-a284-74ee0595af4e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:33.658415 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-83ff7c5f-b8d2-4720-a284-74ee0595af4e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:33.658854 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-83ff7c5f-b8d2-4720-a284-74ee0595af4e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:33.659680 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-83ff7c5f-b8d2-4720-a284-74ee0595af4e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:33.660116 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-83ff7c5f-b8d2-4720-a284-74ee0595af4e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:33.689468 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-871757f9-3e3c-4a82-8620-404ca2e01cb3 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff5219040>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:33.722805 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-871757f9-3e3c-4a82-8620-404ca2e01cb3 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c" status: 200 len: 287 microversion: 2.1 time: 0.039107 Jan 19 16:07:33.723436 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 485/905] 10.222.0.58 () {58 vars in 1250 bytes} [Wed Jan 19 16:07:33 2022] GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:33.800371 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-83ff7c5f-b8d2-4720-a284-74ee0595af4e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:33.808930 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-83ff7c5f-b8d2-4720-a284-74ee0595af4e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:33.810426 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-83ff7c5f-b8d2-4720-a284-74ee0595af4e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:33.811609 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-83ff7c5f-b8d2-4720-a284-74ee0595af4e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.165405 Jan 19 16:07:33.812167 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 421/906] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:33 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:34.742364 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b8e68241-f6ac-47d1-9fa7-4fbf20fce2c6 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff5111940>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:34.772605 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b8e68241-f6ac-47d1-9fa7-4fbf20fce2c6 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c" status: 200 len: 288 microversion: 2.1 time: 0.034480 Jan 19 16:07:34.773256 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 486/907] 10.222.0.58 () {58 vars in 1250 bytes} [Wed Jan 19 16:07:34 2022] GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:34.783383 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-639c4f13-2102-4a57-aca7-2bbf68f0d7cb tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff520f790>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:34.946367 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-639c4f13-2102-4a57-aca7-2bbf68f0d7cb tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c" status: 202 len: 0 microversion: 2.1 time: 0.166516 Jan 19 16:07:34.950953 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 422/908] 10.222.0.58 () {58 vars in 1253 bytes} [Wed Jan 19 16:07:34 2022] DELETE /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:07:34.956313 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-57cfd7b4-889d-4176-a8ce-e618ef036038 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff5113790>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:35.000853 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-57cfd7b4-889d-4176-a8ce-e618ef036038 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c" status: 200 len: 287 microversion: 2.1 time: 0.048472 Jan 19 16:07:35.001648 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 423/909] 10.222.0.58 () {58 vars in 1250 bytes} [Wed Jan 19 16:07:34 2022] GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:07:35.014158 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e35fe371-e4da-454b-b993-2b6fb51b18b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:35.015173 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-e35fe371-e4da-454b-b993-2b6fb51b18b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:35.023293 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e35fe371-e4da-454b-b993-2b6fb51b18b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:35.023816 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e35fe371-e4da-454b-b993-2b6fb51b18b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:35.024625 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e35fe371-e4da-454b-b993-2b6fb51b18b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:35.025395 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e35fe371-e4da-454b-b993-2b6fb51b18b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:35.174852 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e35fe371-e4da-454b-b993-2b6fb51b18b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:35.183525 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e35fe371-e4da-454b-b993-2b6fb51b18b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:35.188317 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e35fe371-e4da-454b-b993-2b6fb51b18b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:35.188317 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e35fe371-e4da-454b-b993-2b6fb51b18b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.360504 Jan 19 16:07:35.188317 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 487/910] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:34 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:07:36.016039 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-cc6a439a-756e-4b3e-912b-a5ec2dadf99f tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff507ed30>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:36.045873 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.wsgi [None req-cc6a439a-756e-4b3e-912b-a5ec2dadf99f tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] HTTP exception thrown: Snapshot f2748dd4-e190-425d-bb54-f9246b68f45c could not be found. Jan 19 16:07:36.046517 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-cc6a439a-756e-4b3e-912b-a5ec2dadf99f tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Returning 404 to user: Snapshot f2748dd4-e190-425d-bb54-f9246b68f45c could not be found. {{(pid=128875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:07:36.047546 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-cc6a439a-756e-4b3e-912b-a5ec2dadf99f tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c" status: 404 len: 111 microversion: 2.1 time: 0.035698 Jan 19 16:07:36.048817 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 424/911] 10.222.0.58 () {58 vars in 1250 bytes} [Wed Jan 19 16:07:36 2022] GET /compute/v2.1/os-snapshots/f2748dd4-e190-425d-bb54-f9246b68f45c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:07:36.058113 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-43cd29bc-23d7-464e-ac5c-dfb7964efe45 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff5111700>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:36.204433 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-0ea4f98a-a6bb-4358-a348-75d48105c099 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:36.205065 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-0ea4f98a-a6bb-4358-a348-75d48105c099 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:36.211273 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0ea4f98a-a6bb-4358-a348-75d48105c099 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:36.216434 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0ea4f98a-a6bb-4358-a348-75d48105c099 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:36.216434 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0ea4f98a-a6bb-4358-a348-75d48105c099 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:36.216434 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0ea4f98a-a6bb-4358-a348-75d48105c099 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:36.276859 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-43cd29bc-23d7-464e-ac5c-dfb7964efe45 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf" status: 202 len: 0 microversion: 2.1 time: 0.223132 Jan 19 16:07:36.277743 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 488/912] 10.222.0.58 () {58 vars in 1247 bytes} [Wed Jan 19 16:07:36 2022] DELETE /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:07:36.286392 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f000e357-5a45-4373-baf1-fdec27144deb tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff50ecee0>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:36.341037 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f000e357-5a45-4373-baf1-fdec27144deb tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf" status: 200 len: 345 microversion: 2.1 time: 0.053117 Jan 19 16:07:36.341037 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 489/913] 10.222.0.58 () {58 vars in 1244 bytes} [Wed Jan 19 16:07:36 2022] GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:36.352451 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-0ea4f98a-a6bb-4358-a348-75d48105c099 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:36.363736 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-0ea4f98a-a6bb-4358-a348-75d48105c099 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:36.365292 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-0ea4f98a-a6bb-4358-a348-75d48105c099 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:36.366439 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-0ea4f98a-a6bb-4358-a348-75d48105c099 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.165976 Jan 19 16:07:36.367006 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 425/914] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:36 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:07:37.348849 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e8321e53-b5af-4c09-8ae6-f8f2c13aa6f2 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff510edc0>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:37.385024 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-cbaf5284-b1c3-4341-9e18-28bdc0208e71 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:37.385759 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-cbaf5284-b1c3-4341-9e18-28bdc0208e71 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:37.392548 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cbaf5284-b1c3-4341-9e18-28bdc0208e71 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:37.393475 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cbaf5284-b1c3-4341-9e18-28bdc0208e71 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:37.394260 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cbaf5284-b1c3-4341-9e18-28bdc0208e71 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:37.394686 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cbaf5284-b1c3-4341-9e18-28bdc0208e71 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:37.395960 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e8321e53-b5af-4c09-8ae6-f8f2c13aa6f2 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf" status: 200 len: 345 microversion: 2.1 time: 0.051288 Jan 19 16:07:37.396531 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 490/915] 10.222.0.58 () {58 vars in 1244 bytes} [Wed Jan 19 16:07:37 2022] GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:37.527638 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-cbaf5284-b1c3-4341-9e18-28bdc0208e71 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:37.535981 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-cbaf5284-b1c3-4341-9e18-28bdc0208e71 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:37.537479 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-cbaf5284-b1c3-4341-9e18-28bdc0208e71 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:37.538622 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-cbaf5284-b1c3-4341-9e18-28bdc0208e71 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.157419 Jan 19 16:07:37.539198 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 426/916] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:37 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:07:38.408730 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-7775ef1c-dfc6-4de9-a83e-3bb810a9b30d tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff50ec9d0>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:38.454911 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-7775ef1c-dfc6-4de9-a83e-3bb810a9b30d tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf" status: 200 len: 345 microversion: 2.1 time: 0.050192 Jan 19 16:07:38.455531 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 491/917] 10.222.0.58 () {58 vars in 1244 bytes} [Wed Jan 19 16:07:38 2022] GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:38.557396 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6c15db70-ca28-488a-bcca-b5e0a39bba3b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:38.557993 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-6c15db70-ca28-488a-bcca-b5e0a39bba3b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:38.564911 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6c15db70-ca28-488a-bcca-b5e0a39bba3b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:38.565988 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6c15db70-ca28-488a-bcca-b5e0a39bba3b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:38.566794 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6c15db70-ca28-488a-bcca-b5e0a39bba3b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:38.567261 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6c15db70-ca28-488a-bcca-b5e0a39bba3b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:38.699968 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6c15db70-ca28-488a-bcca-b5e0a39bba3b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:38.709008 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6c15db70-ca28-488a-bcca-b5e0a39bba3b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:38.710634 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6c15db70-ca28-488a-bcca-b5e0a39bba3b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:38.711830 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6c15db70-ca28-488a-bcca-b5e0a39bba3b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.158354 Jan 19 16:07:38.712386 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 427/918] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:38 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:39.468326 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5f1d0d77-04bc-418a-8902-fd934201bf7a tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff5185ee0>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:39.515433 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5f1d0d77-04bc-418a-8902-fd934201bf7a tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf" status: 200 len: 345 microversion: 2.1 time: 0.051270 Jan 19 16:07:39.516209 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 492/919] 10.222.0.58 () {58 vars in 1244 bytes} [Wed Jan 19 16:07:39 2022] GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:39.730359 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-cfd6cdfa-3fc9-4feb-9ab3-f0ea9d2fee5d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:39.730934 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-cfd6cdfa-3fc9-4feb-9ab3-f0ea9d2fee5d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:39.737339 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cfd6cdfa-3fc9-4feb-9ab3-f0ea9d2fee5d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:39.737778 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cfd6cdfa-3fc9-4feb-9ab3-f0ea9d2fee5d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:39.738717 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cfd6cdfa-3fc9-4feb-9ab3-f0ea9d2fee5d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:39.739190 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cfd6cdfa-3fc9-4feb-9ab3-f0ea9d2fee5d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:39.870480 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-cfd6cdfa-3fc9-4feb-9ab3-f0ea9d2fee5d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:39.879179 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-cfd6cdfa-3fc9-4feb-9ab3-f0ea9d2fee5d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:39.880689 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-cfd6cdfa-3fc9-4feb-9ab3-f0ea9d2fee5d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:39.881846 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-cfd6cdfa-3fc9-4feb-9ab3-f0ea9d2fee5d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.155396 Jan 19 16:07:39.882409 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 428/920] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:39 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:40.528823 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-28ca1555-dd56-41ae-a24c-57091c9fb2bb tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff510e280>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:40.579384 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-28ca1555-dd56-41ae-a24c-57091c9fb2bb tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf" status: 200 len: 345 microversion: 2.1 time: 0.054694 Jan 19 16:07:40.579972 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 493/921] 10.222.0.58 () {58 vars in 1244 bytes} [Wed Jan 19 16:07:40 2022] GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:40.899998 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c94f15ca-115a-4281-997c-46ab4158516a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:40.900696 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c94f15ca-115a-4281-997c-46ab4158516a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:40.906891 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c94f15ca-115a-4281-997c-46ab4158516a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:40.907444 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c94f15ca-115a-4281-997c-46ab4158516a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:40.908235 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c94f15ca-115a-4281-997c-46ab4158516a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:40.908665 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c94f15ca-115a-4281-997c-46ab4158516a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:41.037308 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c94f15ca-115a-4281-997c-46ab4158516a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:41.045831 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c94f15ca-115a-4281-997c-46ab4158516a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:41.047354 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c94f15ca-115a-4281-997c-46ab4158516a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:41.048570 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c94f15ca-115a-4281-997c-46ab4158516a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.152276 Jan 19 16:07:41.049146 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 429/922] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:40 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:41.592280 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c6d1d0e0-2ce9-4774-8f48-7722a3ead42c tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff5214dc0>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:41.647079 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c6d1d0e0-2ce9-4774-8f48-7722a3ead42c tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf" status: 200 len: 345 microversion: 2.1 time: 0.059101 Jan 19 16:07:41.647655 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 494/923] 10.222.0.58 () {58 vars in 1244 bytes} [Wed Jan 19 16:07:41 2022] GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:42.068470 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-94e034a8-bb7c-4039-bf18-63bc248bc2f3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:42.069324 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-94e034a8-bb7c-4039-bf18-63bc248bc2f3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:42.076975 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-94e034a8-bb7c-4039-bf18-63bc248bc2f3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:42.077403 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-94e034a8-bb7c-4039-bf18-63bc248bc2f3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:42.078417 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-94e034a8-bb7c-4039-bf18-63bc248bc2f3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:42.079746 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-94e034a8-bb7c-4039-bf18-63bc248bc2f3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:42.226082 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-94e034a8-bb7c-4039-bf18-63bc248bc2f3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:42.235529 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-94e034a8-bb7c-4039-bf18-63bc248bc2f3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:42.237191 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-94e034a8-bb7c-4039-bf18-63bc248bc2f3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:42.239118 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-94e034a8-bb7c-4039-bf18-63bc248bc2f3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.174190 Jan 19 16:07:42.239627 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 430/924] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:42 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:42.663351 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-2682c0a5-7bcd-496e-acd7-f096327779e8 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff50ecee0>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:42.716258 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-2682c0a5-7bcd-496e-acd7-f096327779e8 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf" status: 200 len: 345 microversion: 2.1 time: 0.059909 Jan 19 16:07:42.717299 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 495/925] 10.222.0.58 () {58 vars in 1244 bytes} [Wed Jan 19 16:07:42 2022] GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:43.257630 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ea4f474b-85a2-41eb-a3fc-94d11e3200cc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:43.258826 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-ea4f474b-85a2-41eb-a3fc-94d11e3200cc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:43.265709 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ea4f474b-85a2-41eb-a3fc-94d11e3200cc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:43.267020 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ea4f474b-85a2-41eb-a3fc-94d11e3200cc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:43.267253 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ea4f474b-85a2-41eb-a3fc-94d11e3200cc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:43.267534 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ea4f474b-85a2-41eb-a3fc-94d11e3200cc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:43.425945 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ea4f474b-85a2-41eb-a3fc-94d11e3200cc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:43.435102 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ea4f474b-85a2-41eb-a3fc-94d11e3200cc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:43.436660 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ea4f474b-85a2-41eb-a3fc-94d11e3200cc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:43.437875 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-ea4f474b-85a2-41eb-a3fc-94d11e3200cc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.184023 Jan 19 16:07:43.438462 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 431/926] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:43 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:43.730497 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3b545eb2-21a1-4fde-a8f6-07289dcacf02 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff510e940>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:43.778129 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3b545eb2-21a1-4fde-a8f6-07289dcacf02 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf" status: 200 len: 345 microversion: 2.1 time: 0.051887 Jan 19 16:07:43.778704 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 496/927] 10.222.0.58 () {58 vars in 1244 bytes} [Wed Jan 19 16:07:43 2022] GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:44.456255 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-3818b996-6678-408b-a148-2d7d2b2acde3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:44.457450 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-3818b996-6678-408b-a148-2d7d2b2acde3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:44.464881 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3818b996-6678-408b-a148-2d7d2b2acde3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:44.465319 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3818b996-6678-408b-a148-2d7d2b2acde3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:44.466105 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3818b996-6678-408b-a148-2d7d2b2acde3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:44.466528 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3818b996-6678-408b-a148-2d7d2b2acde3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:44.632649 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-3818b996-6678-408b-a148-2d7d2b2acde3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:44.641201 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-3818b996-6678-408b-a148-2d7d2b2acde3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:44.642846 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-3818b996-6678-408b-a148-2d7d2b2acde3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:44.644044 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-3818b996-6678-408b-a148-2d7d2b2acde3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.191697 Jan 19 16:07:44.650079 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 432/928] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:44 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:44.791744 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-fdd34bca-bb95-4650-8b4e-49ceb0003c75 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff50e4820>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:44.840222 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-fdd34bca-bb95-4650-8b4e-49ceb0003c75 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf" status: 200 len: 345 microversion: 2.1 time: 0.050245 Jan 19 16:07:44.840222 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 497/929] 10.222.0.58 () {58 vars in 1244 bytes} [Wed Jan 19 16:07:44 2022] GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:45.662431 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-8e84a4cf-fafb-4d9d-8e91-8874b3167670 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:45.663143 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8e84a4cf-fafb-4d9d-8e91-8874b3167670 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:45.669511 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8e84a4cf-fafb-4d9d-8e91-8874b3167670 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:45.669952 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8e84a4cf-fafb-4d9d-8e91-8874b3167670 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:45.670738 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8e84a4cf-fafb-4d9d-8e91-8874b3167670 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:45.671374 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8e84a4cf-fafb-4d9d-8e91-8874b3167670 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:45.839664 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8e84a4cf-fafb-4d9d-8e91-8874b3167670 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:45.850473 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-32cc4557-c4d3-4e15-87b6-6e98ba188083 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff53e1ee0>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:45.852238 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8e84a4cf-fafb-4d9d-8e91-8874b3167670 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:45.853761 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8e84a4cf-fafb-4d9d-8e91-8874b3167670 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:45.854936 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-8e84a4cf-fafb-4d9d-8e91-8874b3167670 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.196850 Jan 19 16:07:45.868356 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 433/930] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:45 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:45.918792 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-32cc4557-c4d3-4e15-87b6-6e98ba188083 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf" status: 200 len: 345 microversion: 2.1 time: 0.064424 Jan 19 16:07:45.918792 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 498/931] 10.222.0.58 () {58 vars in 1244 bytes} [Wed Jan 19 16:07:45 2022] GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:46.875867 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-bb8af4b0-5ece-45bf-9f5a-83c6510ba16d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:46.876403 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-bb8af4b0-5ece-45bf-9f5a-83c6510ba16d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:46.883255 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bb8af4b0-5ece-45bf-9f5a-83c6510ba16d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:46.885591 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bb8af4b0-5ece-45bf-9f5a-83c6510ba16d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:46.885591 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bb8af4b0-5ece-45bf-9f5a-83c6510ba16d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:46.885591 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bb8af4b0-5ece-45bf-9f5a-83c6510ba16d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:46.933927 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a03e4c73-77b6-4a59-bf5d-117ce302face tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff5117670>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:46.995168 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a03e4c73-77b6-4a59-bf5d-117ce302face tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf" status: 200 len: 345 microversion: 2.1 time: 0.066982 Jan 19 16:07:46.995168 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 499/932] 10.222.0.58 () {58 vars in 1244 bytes} [Wed Jan 19 16:07:46 2022] GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:07:47.071666 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-bb8af4b0-5ece-45bf-9f5a-83c6510ba16d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:47.079968 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-bb8af4b0-5ece-45bf-9f5a-83c6510ba16d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:47.081500 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-bb8af4b0-5ece-45bf-9f5a-83c6510ba16d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:47.082930 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-bb8af4b0-5ece-45bf-9f5a-83c6510ba16d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.210750 Jan 19 16:07:47.083576 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 434/933] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:46 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:48.010735 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b112ef08-ad00-4f00-be17-ab2cd9645f48 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff53e1ee0>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:48.036377 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.wsgi [None req-b112ef08-ad00-4f00-be17-ab2cd9645f48 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] HTTP exception thrown: Volume 60f8dd4f-2123-4c71-9308-06eef11a6baf could not be found. Jan 19 16:07:48.036964 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b112ef08-ad00-4f00-be17-ab2cd9645f48 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Returning 404 to user: Volume 60f8dd4f-2123-4c71-9308-06eef11a6baf could not be found. {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:07:48.037784 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b112ef08-ad00-4f00-be17-ab2cd9645f48 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf" status: 404 len: 109 microversion: 2.1 time: 0.031251 Jan 19 16:07:48.038324 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 500/934] 10.222.0.58 () {58 vars in 1244 bytes} [Wed Jan 19 16:07:48 2022] GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 16:07:48.053033 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ce80fe9b-8fd6-4c6a-8a42-c7d2ce13b3ff tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff515ae50>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:48.080204 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.wsgi [None req-ce80fe9b-8fd6-4c6a-8a42-c7d2ce13b3ff tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] HTTP exception thrown: Volume 60f8dd4f-2123-4c71-9308-06eef11a6baf could not be found. Jan 19 16:07:48.080801 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ce80fe9b-8fd6-4c6a-8a42-c7d2ce13b3ff tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Returning 404 to user: Volume 60f8dd4f-2123-4c71-9308-06eef11a6baf could not be found. {{(pid=128875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:07:48.081630 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-ce80fe9b-8fd6-4c6a-8a42-c7d2ce13b3ff tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf" status: 404 len: 109 microversion: 2.1 time: 0.033161 Jan 19 16:07:48.082178 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 435/935] 10.222.0.58 () {58 vars in 1247 bytes} [Wed Jan 19 16:07:48 2022] DELETE /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:07:48.089838 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c6d37608-4f18-496b-ac7f-eeaaffa96315 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Calling method '.version_select at 0x7feff510e430>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:48.101989 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-50b63a21-435f-4478-a21f-1615aa731a4e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:48.102702 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-50b63a21-435f-4478-a21f-1615aa731a4e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:48.109355 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-50b63a21-435f-4478-a21f-1615aa731a4e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:48.109792 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-50b63a21-435f-4478-a21f-1615aa731a4e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:48.110587 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-50b63a21-435f-4478-a21f-1615aa731a4e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:48.111037 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-50b63a21-435f-4478-a21f-1615aa731a4e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:48.117582 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.wsgi [None req-c6d37608-4f18-496b-ac7f-eeaaffa96315 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] HTTP exception thrown: Volume 60f8dd4f-2123-4c71-9308-06eef11a6baf could not be found. Jan 19 16:07:48.118173 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c6d37608-4f18-496b-ac7f-eeaaffa96315 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] Returning 404 to user: Volume 60f8dd4f-2123-4c71-9308-06eef11a6baf could not be found. {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:07:48.119052 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c6d37608-4f18-496b-ac7f-eeaaffa96315 tempest-VolumesSnapshotsTestJSON-1278920168 tempest-VolumesSnapshotsTestJSON-1278920168-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf" status: 404 len: 109 microversion: 2.1 time: 0.032790 Jan 19 16:07:48.119740 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 501/936] 10.222.0.58 () {58 vars in 1244 bytes} [Wed Jan 19 16:07:48 2022] GET /compute/v2.1/os-volumes/60f8dd4f-2123-4c71-9308-06eef11a6baf => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:07:48.256199 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-50b63a21-435f-4478-a21f-1615aa731a4e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:48.265406 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-50b63a21-435f-4478-a21f-1615aa731a4e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:48.266813 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-50b63a21-435f-4478-a21f-1615aa731a4e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:48.268050 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-50b63a21-435f-4478-a21f-1615aa731a4e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.169834 Jan 19 16:07:48.268604 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 436/937] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:48 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:07:49.286801 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-09dbd264-c96e-4dab-a53c-d2b8f34809cd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:49.287525 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-09dbd264-c96e-4dab-a53c-d2b8f34809cd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:49.294508 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-09dbd264-c96e-4dab-a53c-d2b8f34809cd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:49.294948 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-09dbd264-c96e-4dab-a53c-d2b8f34809cd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:49.295830 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-09dbd264-c96e-4dab-a53c-d2b8f34809cd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:49.296257 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-09dbd264-c96e-4dab-a53c-d2b8f34809cd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:49.463456 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-09dbd264-c96e-4dab-a53c-d2b8f34809cd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:49.472139 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-09dbd264-c96e-4dab-a53c-d2b8f34809cd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:49.474242 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-09dbd264-c96e-4dab-a53c-d2b8f34809cd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:49.475462 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-09dbd264-c96e-4dab-a53c-d2b8f34809cd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.193703 Jan 19 16:07:49.476037 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 502/938] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:49 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:50.494363 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c9043e75-528d-4227-9477-181707a968ee tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:50.494890 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c9043e75-528d-4227-9477-181707a968ee tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:50.501270 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c9043e75-528d-4227-9477-181707a968ee tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:50.501706 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c9043e75-528d-4227-9477-181707a968ee tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:50.502666 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c9043e75-528d-4227-9477-181707a968ee tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:50.503119 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c9043e75-528d-4227-9477-181707a968ee tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:50.637578 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c9043e75-528d-4227-9477-181707a968ee tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:50.649680 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c9043e75-528d-4227-9477-181707a968ee tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:50.651238 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c9043e75-528d-4227-9477-181707a968ee tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:50.652423 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c9043e75-528d-4227-9477-181707a968ee tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.161905 Jan 19 16:07:50.652979 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 437/939] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:50 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:51.670582 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-49309e62-894d-41dd-a61d-dc53e2ef6a96 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:51.671239 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-49309e62-894d-41dd-a61d-dc53e2ef6a96 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:51.677523 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-49309e62-894d-41dd-a61d-dc53e2ef6a96 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:51.677965 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-49309e62-894d-41dd-a61d-dc53e2ef6a96 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:51.679100 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-49309e62-894d-41dd-a61d-dc53e2ef6a96 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:51.679610 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-49309e62-894d-41dd-a61d-dc53e2ef6a96 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:51.818991 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-49309e62-894d-41dd-a61d-dc53e2ef6a96 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:51.833201 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-49309e62-894d-41dd-a61d-dc53e2ef6a96 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:51.834775 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-49309e62-894d-41dd-a61d-dc53e2ef6a96 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:51.836048 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-49309e62-894d-41dd-a61d-dc53e2ef6a96 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.169144 Jan 19 16:07:51.836563 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 503/940] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:51 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:52.854623 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-11c3832f-6166-49b8-b660-ec0b99cdb113 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:52.855195 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-11c3832f-6166-49b8-b660-ec0b99cdb113 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:52.862020 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-11c3832f-6166-49b8-b660-ec0b99cdb113 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:52.865880 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-11c3832f-6166-49b8-b660-ec0b99cdb113 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:52.865880 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-11c3832f-6166-49b8-b660-ec0b99cdb113 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:52.865880 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-11c3832f-6166-49b8-b660-ec0b99cdb113 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:53.027756 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-11c3832f-6166-49b8-b660-ec0b99cdb113 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:53.044033 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-11c3832f-6166-49b8-b660-ec0b99cdb113 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:53.046846 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-11c3832f-6166-49b8-b660-ec0b99cdb113 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:53.049040 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-11c3832f-6166-49b8-b660-ec0b99cdb113 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.198287 Jan 19 16:07:53.050104 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 438/941] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:52 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:07:53.792103 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-8f4d30f8-9308-4206-acd0-f0f87199bc3a req-48d9bb77-454b-47ad-bda2-bbbcd7e08303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02ba601a-94e7-486f-9d1b-7418ae534f4f", "name": "network-vif-plugged", "status": "completed", "tag": "51ed4245-58bf-4cc7-838e-9cad3734639e"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:07:53.794582 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:07:53.794582 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:07:53.804205 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-8f4d30f8-9308-4206-acd0-f0f87199bc3a req-48d9bb77-454b-47ad-bda2-bbbcd7e08303 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:53.804861 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-8f4d30f8-9308-4206-acd0-f0f87199bc3a req-48d9bb77-454b-47ad-bda2-bbbcd7e08303 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:53.821805 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-8f4d30f8-9308-4206-acd0-f0f87199bc3a req-48d9bb77-454b-47ad-bda2-bbbcd7e08303 service nova] Creating event network-vif-plugged:51ed4245-58bf-4cc7-838e-9cad3734639e for instance 02ba601a-94e7-486f-9d1b-7418ae534f4f on hv-cinder-82002 Jan 19 16:07:53.826424 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-8f4d30f8-9308-4206-acd0-f0f87199bc3a req-48d9bb77-454b-47ad-bda2-bbbcd7e08303 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038153 Jan 19 16:07:53.827053 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 504/942] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:07:54.077937 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-b6dccdd0-7f3f-4a44-b5e3-2810a7774ff3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:54.078709 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-b6dccdd0-7f3f-4a44-b5e3-2810a7774ff3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:54.085754 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b6dccdd0-7f3f-4a44-b5e3-2810a7774ff3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:54.086206 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b6dccdd0-7f3f-4a44-b5e3-2810a7774ff3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:54.087012 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b6dccdd0-7f3f-4a44-b5e3-2810a7774ff3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:54.087449 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b6dccdd0-7f3f-4a44-b5e3-2810a7774ff3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:54.224125 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-b6dccdd0-7f3f-4a44-b5e3-2810a7774ff3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:54.232403 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-b6dccdd0-7f3f-4a44-b5e3-2810a7774ff3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:54.233912 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-b6dccdd0-7f3f-4a44-b5e3-2810a7774ff3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:54.235122 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-b6dccdd0-7f3f-4a44-b5e3-2810a7774ff3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.160843 Jan 19 16:07:54.235691 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 439/943] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:54 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:55.267405 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e293a6dc-433f-4948-b04e-bf512854fe4b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:55.269848 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-e293a6dc-433f-4948-b04e-bf512854fe4b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:55.278061 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e293a6dc-433f-4948-b04e-bf512854fe4b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:55.278746 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e293a6dc-433f-4948-b04e-bf512854fe4b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:55.279597 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e293a6dc-433f-4948-b04e-bf512854fe4b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:55.280025 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e293a6dc-433f-4948-b04e-bf512854fe4b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:55.443806 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e293a6dc-433f-4948-b04e-bf512854fe4b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:55.453307 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e293a6dc-433f-4948-b04e-bf512854fe4b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:55.455264 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e293a6dc-433f-4948-b04e-bf512854fe4b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:55.456565 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e293a6dc-433f-4948-b04e-bf512854fe4b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.206897 Jan 19 16:07:55.457134 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 505/944] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:55 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:56.484189 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-a79ae3f1-15c1-4117-a38f-81651181352e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:56.484803 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-a79ae3f1-15c1-4117-a38f-81651181352e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:56.493089 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a79ae3f1-15c1-4117-a38f-81651181352e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:56.493539 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a79ae3f1-15c1-4117-a38f-81651181352e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:56.494380 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a79ae3f1-15c1-4117-a38f-81651181352e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:56.495139 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a79ae3f1-15c1-4117-a38f-81651181352e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:56.685986 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-a79ae3f1-15c1-4117-a38f-81651181352e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:56.697831 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-a79ae3f1-15c1-4117-a38f-81651181352e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:56.699849 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-a79ae3f1-15c1-4117-a38f-81651181352e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:56.701396 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-a79ae3f1-15c1-4117-a38f-81651181352e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.221809 Jan 19 16:07:56.702537 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 440/945] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:56 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:57.719927 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-2b8a9337-3b3d-4c7a-abbc-8f8b90b98d54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:57.720524 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-2b8a9337-3b3d-4c7a-abbc-8f8b90b98d54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:57.726445 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2b8a9337-3b3d-4c7a-abbc-8f8b90b98d54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:57.726884 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2b8a9337-3b3d-4c7a-abbc-8f8b90b98d54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:57.727686 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2b8a9337-3b3d-4c7a-abbc-8f8b90b98d54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:57.728281 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2b8a9337-3b3d-4c7a-abbc-8f8b90b98d54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:57.871191 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-2b8a9337-3b3d-4c7a-abbc-8f8b90b98d54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:57.880588 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-2b8a9337-3b3d-4c7a-abbc-8f8b90b98d54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:57.882149 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-2b8a9337-3b3d-4c7a-abbc-8f8b90b98d54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:57.883513 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-2b8a9337-3b3d-4c7a-abbc-8f8b90b98d54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1805 microversion: 2.20 time: 0.167565 Jan 19 16:07:57.884096 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 506/946] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:57 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1805 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:57.993145 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-17636b8a-e451-418a-bc7f-cd9ae9e0a08d tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:57.993718 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-17636b8a-e451-418a-bc7f-cd9ae9e0a08d tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 7bc80974-719e-4432-9f6e-2f00a7bf09a3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:58.000304 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-17636b8a-e451-418a-bc7f-cd9ae9e0a08d tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:58.000749 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-17636b8a-e451-418a-bc7f-cd9ae9e0a08d tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:58.006025 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-17636b8a-e451-418a-bc7f-cd9ae9e0a08d tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:58.006025 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-17636b8a-e451-418a-bc7f-cd9ae9e0a08d tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:58.243603 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.objects.instance [None req-17636b8a-e451-418a-bc7f-cd9ae9e0a08d tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lazy-loading 'services' on Instance uuid 7bc80974-719e-4432-9f6e-2f00a7bf09a3 {{(pid=128875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:07:58.569454 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-17636b8a-e451-418a-bc7f-cd9ae9e0a08d tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3/os-volume_attachments/435a31f7-ae71-43c7-bf39-41c7017a5fe1" status: 202 len: 0 microversion: 2.1 time: 0.579963 Jan 19 16:07:58.570043 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 441/947] 10.222.0.58 () {58 vars in 1415 bytes} [Wed Jan 19 16:07:57 2022] DELETE /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3/os-volume_attachments/435a31f7-ae71-43c7-bf39-41c7017a5fe1 => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:07:58.901734 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-693fdb9e-e398-4b63-a3b4-2ccc7d2f49dd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:58.902296 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-693fdb9e-e398-4b63-a3b4-2ccc7d2f49dd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:58.908818 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-693fdb9e-e398-4b63-a3b4-2ccc7d2f49dd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:58.909276 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-693fdb9e-e398-4b63-a3b4-2ccc7d2f49dd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:58.910033 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-693fdb9e-e398-4b63-a3b4-2ccc7d2f49dd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:58.910461 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-693fdb9e-e398-4b63-a3b4-2ccc7d2f49dd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:59.042046 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-693fdb9e-e398-4b63-a3b4-2ccc7d2f49dd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:59.050920 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-693fdb9e-e398-4b63-a3b4-2ccc7d2f49dd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:59.053095 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-693fdb9e-e398-4b63-a3b4-2ccc7d2f49dd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:07:59.054534 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-693fdb9e-e398-4b63-a3b4-2ccc7d2f49dd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1792 microversion: 2.20 time: 0.156632 Jan 19 16:07:59.055176 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 507/948] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:07:58 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1792 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:07:59.726524 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c48f0e70-80ed-4298-bde4-6c7e175ddfd7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:07:59.727140 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c48f0e70-80ed-4298-bde4-6c7e175ddfd7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 7bc80974-719e-4432-9f6e-2f00a7bf09a3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:07:59.733277 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c48f0e70-80ed-4298-bde4-6c7e175ddfd7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:59.733714 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c48f0e70-80ed-4298-bde4-6c7e175ddfd7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:59.734474 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c48f0e70-80ed-4298-bde4-6c7e175ddfd7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:07:59.734899 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c48f0e70-80ed-4298-bde4-6c7e175ddfd7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:07:59.759064 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c48f0e70-80ed-4298-bde4-6c7e175ddfd7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 7bc80974-719e-4432-9f6e-2f00a7bf09a3] Going to try to terminate instance {{(pid=128875) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:08:00.161633 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c48f0e70-80ed-4298-bde4-6c7e175ddfd7 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3" status: 204 len: 0 microversion: 2.1 time: 0.438606 Jan 19 16:08:00.162280 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 442/949] 10.222.0.58 () {58 vars in 1238 bytes} [Wed Jan 19 16:07:59 2022] DELETE /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:08:00.170352 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-fff3f199-8f57-460d-9230-51c44cc5ad2c tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:00.170949 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-fff3f199-8f57-460d-9230-51c44cc5ad2c tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 7bc80974-719e-4432-9f6e-2f00a7bf09a3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:00.177375 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fff3f199-8f57-460d-9230-51c44cc5ad2c tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:00.177817 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fff3f199-8f57-460d-9230-51c44cc5ad2c tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:00.178859 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fff3f199-8f57-460d-9230-51c44cc5ad2c tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:00.179388 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fff3f199-8f57-460d-9230-51c44cc5ad2c tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:00.336505 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-fff3f199-8f57-460d-9230-51c44cc5ad2c tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:00.344693 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-fff3f199-8f57-460d-9230-51c44cc5ad2c tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3" status: 200 len: 1511 microversion: 2.1 time: 0.177877 Jan 19 16:08:00.345373 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 508/950] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:00 2022] GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3 => generated 1511 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:08:01.363563 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-64819963-37e8-4b7a-9fed-d89a99a6929b tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:01.364363 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-64819963-37e8-4b7a-9fed-d89a99a6929b tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 7bc80974-719e-4432-9f6e-2f00a7bf09a3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:01.370709 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-64819963-37e8-4b7a-9fed-d89a99a6929b tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:01.371184 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-64819963-37e8-4b7a-9fed-d89a99a6929b tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:01.371967 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-64819963-37e8-4b7a-9fed-d89a99a6929b tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:01.372393 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-64819963-37e8-4b7a-9fed-d89a99a6929b tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:01.515389 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-64819963-37e8-4b7a-9fed-d89a99a6929b tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:01.524272 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-64819963-37e8-4b7a-9fed-d89a99a6929b tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3" status: 200 len: 1511 microversion: 2.1 time: 0.164920 Jan 19 16:08:01.525048 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 443/951] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:01 2022] GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3 => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:08:02.545926 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-9c928aa3-946a-41ac-a71e-79100f2f992f tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:02.554362 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-9c928aa3-946a-41ac-a71e-79100f2f992f tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 7bc80974-719e-4432-9f6e-2f00a7bf09a3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:02.562425 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9c928aa3-946a-41ac-a71e-79100f2f992f tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:02.563834 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9c928aa3-946a-41ac-a71e-79100f2f992f tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:02.563834 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9c928aa3-946a-41ac-a71e-79100f2f992f tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:02.564362 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9c928aa3-946a-41ac-a71e-79100f2f992f tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:02.708013 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-9c928aa3-946a-41ac-a71e-79100f2f992f tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:02.716473 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-9c928aa3-946a-41ac-a71e-79100f2f992f tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3" status: 200 len: 1511 microversion: 2.1 time: 0.174411 Jan 19 16:08:02.717054 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 509/952] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:02 2022] GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3 => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:08:03.012568 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-34b9100b-4900-42f6-8a04-a674e27334e1 req-7885702b-bdc7-4863-8cdf-43c683bcd441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc80974-719e-4432-9f6e-2f00a7bf09a3", "name": "network-vif-deleted", "tag": "c3b0437c-f450-4051-a99a-a5a3ccaab74b"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:08:03.014242 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:08:03.014242 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:08:03.022990 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-34b9100b-4900-42f6-8a04-a674e27334e1 req-7885702b-bdc7-4863-8cdf-43c683bcd441 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:03.023447 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-34b9100b-4900-42f6-8a04-a674e27334e1 req-7885702b-bdc7-4863-8cdf-43c683bcd441 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:03.036810 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-34b9100b-4900-42f6-8a04-a674e27334e1 req-7885702b-bdc7-4863-8cdf-43c683bcd441 service nova] Creating event network-vif-deleted:c3b0437c-f450-4051-a99a-a5a3ccaab74b for instance 7bc80974-719e-4432-9f6e-2f00a7bf09a3 on hv-cinder-82002 Jan 19 16:08:03.042290 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-34b9100b-4900-42f6-8a04-a674e27334e1 req-7885702b-bdc7-4863-8cdf-43c683bcd441 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211026 Jan 19 16:08:03.042889 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 444/953] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:08:03.734029 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8e2d1d9a-ca44-402d-bdaf-3a60ef6ed900 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:03.734632 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-8e2d1d9a-ca44-402d-bdaf-3a60ef6ed900 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 7bc80974-719e-4432-9f6e-2f00a7bf09a3] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:03.741841 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8e2d1d9a-ca44-402d-bdaf-3a60ef6ed900 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:03.742321 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8e2d1d9a-ca44-402d-bdaf-3a60ef6ed900 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:03.743153 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8e2d1d9a-ca44-402d-bdaf-3a60ef6ed900 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:03.743582 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8e2d1d9a-ca44-402d-bdaf-3a60ef6ed900 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:03.778785 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8e2d1d9a-ca44-402d-bdaf-3a60ef6ed900 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:03.779254 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8e2d1d9a-ca44-402d-bdaf-3a60ef6ed900 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:03.779700 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.objects.instance [None req-8e2d1d9a-ca44-402d-bdaf-3a60ef6ed900 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lazy-loading 'fault' on Instance uuid 7bc80974-719e-4432-9f6e-2f00a7bf09a3 {{(pid=128876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:08:03.821993 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8e2d1d9a-ca44-402d-bdaf-3a60ef6ed900 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be467c547439aa51edb2b18d2f906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c338a65c4354429b3e8afe68e5a754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:03.829680 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-8e2d1d9a-ca44-402d-bdaf-3a60ef6ed900 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3" status: 200 len: 1308 microversion: 2.1 time: 0.099385 Jan 19 16:08:03.831150 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 510/954] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:03 2022] GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3 => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:08:04.848794 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-4b4f5c8e-8220-40df-b452-b80dbf708438 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:04.849541 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-4b4f5c8e-8220-40df-b452-b80dbf708438 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] [instance: 7bc80974-719e-4432-9f6e-2f00a7bf09a3] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:04.856218 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4b4f5c8e-8220-40df-b452-b80dbf708438 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:04.856697 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4b4f5c8e-8220-40df-b452-b80dbf708438 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:04.857495 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4b4f5c8e-8220-40df-b452-b80dbf708438 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:04.857936 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4b4f5c8e-8220-40df-b452-b80dbf708438 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:04.872337 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.wsgi [None req-4b4f5c8e-8220-40df-b452-b80dbf708438 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] HTTP exception thrown: Instance 7bc80974-719e-4432-9f6e-2f00a7bf09a3 could not be found. Jan 19 16:08:04.872939 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-4b4f5c8e-8220-40df-b452-b80dbf708438 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] Returning 404 to user: Instance 7bc80974-719e-4432-9f6e-2f00a7bf09a3 could not be found. {{(pid=128875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:08:04.873765 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-4b4f5c8e-8220-40df-b452-b80dbf708438 tempest-VolumesSnapshotTestJSON-443090313 tempest-VolumesSnapshotTestJSON-443090313-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3" status: 404 len: 111 microversion: 2.1 time: 0.030054 Jan 19 16:08:04.874318 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 445/955] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:04 2022] GET /compute/v2.1/servers/7bc80974-719e-4432-9f6e-2f00a7bf09a3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 16:08:14.460537 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d81a60ce-3510-40a6-940c-9f9969dd4684 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-376947155", "imageRef": "6d9c05bd-015a-44de-bd51-f744cb247e7a", "flavorRef": "452"}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:08:14.528029 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.network.neutron [None req-d81a60ce-3510-40a6-940c-9f9969dd4684 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] validate_networks() for None {{(pid=128876) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:08:14.820694 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-d81a60ce-3510-40a6-940c-9f9969dd4684 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Flavor limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:08:14.821386 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-d81a60ce-3510-40a6-940c-9f9969dd4684 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Image limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:08:14.821865 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-d81a60ce-3510-40a6-940c-9f9969dd4684 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Flavor pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:08:14.822270 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-d81a60ce-3510-40a6-940c-9f9969dd4684 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Image pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:08:14.822673 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-d81a60ce-3510-40a6-940c-9f9969dd4684 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:08:14.834014 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d81a60ce-3510-40a6-940c-9f9969dd4684 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:14.834455 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d81a60ce-3510-40a6-940c-9f9969dd4684 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:14.835321 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d81a60ce-3510-40a6-940c-9f9969dd4684 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:14.835756 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d81a60ce-3510-40a6-940c-9f9969dd4684 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:14.853348 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-d81a60ce-3510-40a6-940c-9f9969dd4684 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Getting quotas for project e9c4d5c13f3844eeb65d7aab9a1d5864. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:08:14.858230 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-d81a60ce-3510-40a6-940c-9f9969dd4684 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Getting quotas for user 5d4d3f0f79a043ffaa7882cf3ecfed1f and project e9c4d5c13f3844eeb65d7aab9a1d5864. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:08:14.870804 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-d81a60ce-3510-40a6-940c-9f9969dd4684 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Going to run 1 instances... {{(pid=128876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:08:14.873207 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-d81a60ce-3510-40a6-940c-9f9969dd4684 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] [instance: 16f28376-6e47-4237-98f2-4e60adaa04e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6d9c05bd-015a-44de-bd51-f744cb247e7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:08:15.035917 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-d81a60ce-3510-40a6-940c-9f9969dd4684 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.579707 Jan 19 16:08:15.036571 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 511/956] 10.222.0.58 () {60 vars in 1146 bytes} [Wed Jan 19 16:08:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:08:15.047120 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-87399767-244c-4c1e-a769-eaee555387be tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:15.047651 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-87399767-244c-4c1e-a769-eaee555387be tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] [instance: 16f28376-6e47-4237-98f2-4e60adaa04e2] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:15.104813 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-87399767-244c-4c1e-a769-eaee555387be tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4d3f0f79a043ffaa7882cf3ecfed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c4d5c13f3844eeb65d7aab9a1d5864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:15.112565 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-87399767-244c-4c1e-a769-eaee555387be tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] 10.222.0.58 "GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2" status: 200 len: 1214 microversion: 2.1 time: 0.069510 Jan 19 16:08:15.113151 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 446/957] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:15 2022] GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:08:16.130233 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-7f73b491-18c9-4f8e-ab1a-023fdf5d8b7f tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:16.131032 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-7f73b491-18c9-4f8e-ab1a-023fdf5d8b7f tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] [instance: 16f28376-6e47-4237-98f2-4e60adaa04e2] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:16.186377 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-7f73b491-18c9-4f8e-ab1a-023fdf5d8b7f tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4d3f0f79a043ffaa7882cf3ecfed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c4d5c13f3844eeb65d7aab9a1d5864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:16.193640 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-7f73b491-18c9-4f8e-ab1a-023fdf5d8b7f tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] 10.222.0.58 "GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2" status: 200 len: 1214 microversion: 2.1 time: 0.067695 Jan 19 16:08:16.194221 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 512/958] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:16 2022] GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:08:17.211196 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f31bccfe-a8b4-42d4-828d-d46557f383c6 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:17.211743 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-f31bccfe-a8b4-42d4-828d-d46557f383c6 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] [instance: 16f28376-6e47-4237-98f2-4e60adaa04e2] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:17.218748 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f31bccfe-a8b4-42d4-828d-d46557f383c6 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:17.219222 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f31bccfe-a8b4-42d4-828d-d46557f383c6 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:17.220007 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f31bccfe-a8b4-42d4-828d-d46557f383c6 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:17.221082 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f31bccfe-a8b4-42d4-828d-d46557f383c6 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:17.280860 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-f31bccfe-a8b4-42d4-828d-d46557f383c6 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4d3f0f79a043ffaa7882cf3ecfed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c4d5c13f3844eeb65d7aab9a1d5864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:17.289093 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f31bccfe-a8b4-42d4-828d-d46557f383c6 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] 10.222.0.58 "GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2" status: 200 len: 1266 microversion: 2.1 time: 0.082106 Jan 19 16:08:17.289663 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 447/959] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:17 2022] GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:08:18.310263 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-de486ed1-56b0-4848-875c-06de44fd7890 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:18.314316 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-de486ed1-56b0-4848-875c-06de44fd7890 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] [instance: 16f28376-6e47-4237-98f2-4e60adaa04e2] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:18.326605 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-de486ed1-56b0-4848-875c-06de44fd7890 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:18.327344 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-de486ed1-56b0-4848-875c-06de44fd7890 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:18.328150 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-de486ed1-56b0-4848-875c-06de44fd7890 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:18.328579 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-de486ed1-56b0-4848-875c-06de44fd7890 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:18.392047 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-de486ed1-56b0-4848-875c-06de44fd7890 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4d3f0f79a043ffaa7882cf3ecfed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c4d5c13f3844eeb65d7aab9a1d5864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:18.400160 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-de486ed1-56b0-4848-875c-06de44fd7890 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] 10.222.0.58 "GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2" status: 200 len: 1272 microversion: 2.1 time: 0.097720 Jan 19 16:08:18.400879 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 513/960] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:18 2022] GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2 => generated 1272 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:08:19.417108 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d0198fd4-a247-4481-9bab-46e51ae897c5 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:19.417818 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d0198fd4-a247-4481-9bab-46e51ae897c5 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] [instance: 16f28376-6e47-4237-98f2-4e60adaa04e2] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:19.424103 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d0198fd4-a247-4481-9bab-46e51ae897c5 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:19.424541 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d0198fd4-a247-4481-9bab-46e51ae897c5 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:19.425305 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d0198fd4-a247-4481-9bab-46e51ae897c5 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:19.425727 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d0198fd4-a247-4481-9bab-46e51ae897c5 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:19.570059 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d0198fd4-a247-4481-9bab-46e51ae897c5 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4d3f0f79a043ffaa7882cf3ecfed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c4d5c13f3844eeb65d7aab9a1d5864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:19.577509 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d0198fd4-a247-4481-9bab-46e51ae897c5 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] 10.222.0.58 "GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2" status: 200 len: 1314 microversion: 2.1 time: 0.164198 Jan 19 16:08:19.578080 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 448/961] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:19 2022] GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:08:20.596077 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5b67383b-700f-491d-b5e5-7106e0a3e332 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:20.596077 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5b67383b-700f-491d-b5e5-7106e0a3e332 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] [instance: 16f28376-6e47-4237-98f2-4e60adaa04e2] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:20.601297 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5b67383b-700f-491d-b5e5-7106e0a3e332 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:20.601381 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5b67383b-700f-491d-b5e5-7106e0a3e332 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:20.602115 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5b67383b-700f-491d-b5e5-7106e0a3e332 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:20.602578 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5b67383b-700f-491d-b5e5-7106e0a3e332 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:20.754215 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5b67383b-700f-491d-b5e5-7106e0a3e332 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4d3f0f79a043ffaa7882cf3ecfed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c4d5c13f3844eeb65d7aab9a1d5864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:20.755997 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-1d9bbd71-f2a8-4e4d-ad0d-814facd95878 req-b8ff9484-a660-4569-bd0a-1ada3bdec64e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16f28376-6e47-4237-98f2-4e60adaa04e2", "tag": "2d7d2a7a-a8fe-48ee-b688-d5785b4405a7"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:08:20.759104 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:08:20.759104 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:08:20.762884 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5b67383b-700f-491d-b5e5-7106e0a3e332 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] 10.222.0.58 "GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2" status: 200 len: 1314 microversion: 2.1 time: 0.172608 Jan 19 16:08:20.763462 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 514/962] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:20 2022] GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:08:20.768344 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-1d9bbd71-f2a8-4e4d-ad0d-814facd95878 req-b8ff9484-a660-4569-bd0a-1ada3bdec64e service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:20.773016 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-1d9bbd71-f2a8-4e4d-ad0d-814facd95878 req-b8ff9484-a660-4569-bd0a-1ada3bdec64e service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:20.781583 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-1d9bbd71-f2a8-4e4d-ad0d-814facd95878 req-b8ff9484-a660-4569-bd0a-1ada3bdec64e service nova] Creating event network-changed:2d7d2a7a-a8fe-48ee-b688-d5785b4405a7 for instance 16f28376-6e47-4237-98f2-4e60adaa04e2 on hv-cinder-82002 Jan 19 16:08:20.786467 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-1d9bbd71-f2a8-4e4d-ad0d-814facd95878 req-b8ff9484-a660-4569-bd0a-1ada3bdec64e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034055 Jan 19 16:08:20.787225 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 449/963] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:08:21.781910 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-29afaaf5-911b-4437-9fa5-a5c8e60ad599 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:21.782518 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-29afaaf5-911b-4437-9fa5-a5c8e60ad599 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] [instance: 16f28376-6e47-4237-98f2-4e60adaa04e2] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:21.791221 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-29afaaf5-911b-4437-9fa5-a5c8e60ad599 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:21.791672 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-29afaaf5-911b-4437-9fa5-a5c8e60ad599 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:21.792482 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-29afaaf5-911b-4437-9fa5-a5c8e60ad599 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:21.792929 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-29afaaf5-911b-4437-9fa5-a5c8e60ad599 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:21.926550 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-29afaaf5-911b-4437-9fa5-a5c8e60ad599 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4d3f0f79a043ffaa7882cf3ecfed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c4d5c13f3844eeb65d7aab9a1d5864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:21.934771 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-29afaaf5-911b-4437-9fa5-a5c8e60ad599 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] 10.222.0.58 "GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2" status: 200 len: 1314 microversion: 2.1 time: 0.157691 Jan 19 16:08:21.935381 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 515/964] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:21 2022] GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:08:22.952099 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d04abde2-ab47-4acc-862a-446696f09912 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:22.952823 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d04abde2-ab47-4acc-862a-446696f09912 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] [instance: 16f28376-6e47-4237-98f2-4e60adaa04e2] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:22.959119 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d04abde2-ab47-4acc-862a-446696f09912 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:22.962038 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d04abde2-ab47-4acc-862a-446696f09912 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:22.962038 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d04abde2-ab47-4acc-862a-446696f09912 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:22.962038 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d04abde2-ab47-4acc-862a-446696f09912 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:23.103478 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d04abde2-ab47-4acc-862a-446696f09912 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4d3f0f79a043ffaa7882cf3ecfed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c4d5c13f3844eeb65d7aab9a1d5864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:23.110901 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d04abde2-ab47-4acc-862a-446696f09912 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] 10.222.0.58 "GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2" status: 200 len: 1314 microversion: 2.1 time: 0.163261 Jan 19 16:08:23.111636 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 450/965] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:22 2022] GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:08:24.129552 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5aa8c61b-98bd-4fc5-a166-dbb31aa088e1 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:24.130311 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5aa8c61b-98bd-4fc5-a166-dbb31aa088e1 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] [instance: 16f28376-6e47-4237-98f2-4e60adaa04e2] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:24.138385 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5aa8c61b-98bd-4fc5-a166-dbb31aa088e1 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:24.139146 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5aa8c61b-98bd-4fc5-a166-dbb31aa088e1 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:24.140024 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5aa8c61b-98bd-4fc5-a166-dbb31aa088e1 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:24.140519 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5aa8c61b-98bd-4fc5-a166-dbb31aa088e1 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:24.276233 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5aa8c61b-98bd-4fc5-a166-dbb31aa088e1 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4d3f0f79a043ffaa7882cf3ecfed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c4d5c13f3844eeb65d7aab9a1d5864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:24.283863 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5aa8c61b-98bd-4fc5-a166-dbb31aa088e1 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] 10.222.0.58 "GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2" status: 200 len: 1314 microversion: 2.1 time: 0.158276 Jan 19 16:08:24.284440 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 516/966] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:24 2022] GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:08:25.300836 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-9d79d400-30b3-4ec4-aea0-dad50cdb9af4 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:25.301433 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-9d79d400-30b3-4ec4-aea0-dad50cdb9af4 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] [instance: 16f28376-6e47-4237-98f2-4e60adaa04e2] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:25.308638 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9d79d400-30b3-4ec4-aea0-dad50cdb9af4 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:25.309141 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9d79d400-30b3-4ec4-aea0-dad50cdb9af4 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:25.310151 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9d79d400-30b3-4ec4-aea0-dad50cdb9af4 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:25.310580 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9d79d400-30b3-4ec4-aea0-dad50cdb9af4 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:25.442445 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-9d79d400-30b3-4ec4-aea0-dad50cdb9af4 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4d3f0f79a043ffaa7882cf3ecfed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c4d5c13f3844eeb65d7aab9a1d5864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:25.450169 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-9d79d400-30b3-4ec4-aea0-dad50cdb9af4 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] 10.222.0.58 "GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2" status: 200 len: 1314 microversion: 2.1 time: 0.153190 Jan 19 16:08:25.454755 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 451/967] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:25 2022] GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:08:26.467344 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-12eb9e08-7197-4601-97df-084027cb4e32 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:26.467957 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-12eb9e08-7197-4601-97df-084027cb4e32 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] [instance: 16f28376-6e47-4237-98f2-4e60adaa04e2] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:26.474311 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-12eb9e08-7197-4601-97df-084027cb4e32 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:26.474761 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-12eb9e08-7197-4601-97df-084027cb4e32 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:26.475598 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-12eb9e08-7197-4601-97df-084027cb4e32 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:26.476034 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-12eb9e08-7197-4601-97df-084027cb4e32 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:26.627735 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-12eb9e08-7197-4601-97df-084027cb4e32 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4d3f0f79a043ffaa7882cf3ecfed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c4d5c13f3844eeb65d7aab9a1d5864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:26.635717 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-12eb9e08-7197-4601-97df-084027cb4e32 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] 10.222.0.58 "GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2" status: 200 len: 1314 microversion: 2.1 time: 0.172221 Jan 19 16:08:26.636310 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 517/968] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:26 2022] GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:08:27.652419 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-fc7982de-aa5f-4b87-8a12-ece5d1c2ac49 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:27.653069 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-fc7982de-aa5f-4b87-8a12-ece5d1c2ac49 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] [instance: 16f28376-6e47-4237-98f2-4e60adaa04e2] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:27.659278 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fc7982de-aa5f-4b87-8a12-ece5d1c2ac49 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:27.659708 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fc7982de-aa5f-4b87-8a12-ece5d1c2ac49 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:27.660481 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fc7982de-aa5f-4b87-8a12-ece5d1c2ac49 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:27.660949 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fc7982de-aa5f-4b87-8a12-ece5d1c2ac49 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:27.810128 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-fc7982de-aa5f-4b87-8a12-ece5d1c2ac49 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4d3f0f79a043ffaa7882cf3ecfed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c4d5c13f3844eeb65d7aab9a1d5864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:27.818320 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-fc7982de-aa5f-4b87-8a12-ece5d1c2ac49 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] 10.222.0.58 "GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2" status: 200 len: 1314 microversion: 2.1 time: 0.169611 Jan 19 16:08:27.818891 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 452/969] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:27 2022] GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:08:28.453088 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-b17ca3ce-5039-4a57-9699-b9d0082294eb req-a072d903-4df6-4447-b29e-34bd73da4c08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f28376-6e47-4237-98f2-4e60adaa04e2", "name": "network-vif-plugged", "status": "completed", "tag": "2d7d2a7a-a8fe-48ee-b688-d5785b4405a7"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:08:28.454698 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:08:28.454698 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:08:28.461528 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-b17ca3ce-5039-4a57-9699-b9d0082294eb req-a072d903-4df6-4447-b29e-34bd73da4c08 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:28.466703 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-b17ca3ce-5039-4a57-9699-b9d0082294eb req-a072d903-4df6-4447-b29e-34bd73da4c08 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:28.475970 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-b17ca3ce-5039-4a57-9699-b9d0082294eb req-a072d903-4df6-4447-b29e-34bd73da4c08 service nova] Creating event network-vif-plugged:2d7d2a7a-a8fe-48ee-b688-d5785b4405a7 for instance 16f28376-6e47-4237-98f2-4e60adaa04e2 on hv-cinder-82002 Jan 19 16:08:28.481665 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-b17ca3ce-5039-4a57-9699-b9d0082294eb req-a072d903-4df6-4447-b29e-34bd73da4c08 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211592 Jan 19 16:08:28.482266 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 518/970] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:08:28.842562 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d9e44377-217c-4973-afda-ca8d7b1df13e tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:28.843338 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d9e44377-217c-4973-afda-ca8d7b1df13e tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] [instance: 16f28376-6e47-4237-98f2-4e60adaa04e2] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:28.849891 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d9e44377-217c-4973-afda-ca8d7b1df13e tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:28.850334 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d9e44377-217c-4973-afda-ca8d7b1df13e tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:28.851166 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d9e44377-217c-4973-afda-ca8d7b1df13e tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:28.851600 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d9e44377-217c-4973-afda-ca8d7b1df13e tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:29.026760 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d9e44377-217c-4973-afda-ca8d7b1df13e tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4d3f0f79a043ffaa7882cf3ecfed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c4d5c13f3844eeb65d7aab9a1d5864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:29.035431 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d9e44377-217c-4973-afda-ca8d7b1df13e tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] 10.222.0.58 "GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2" status: 200 len: 1314 microversion: 2.1 time: 0.196507 Jan 19 16:08:29.036147 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 453/971] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:28 2022] GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:08:30.052881 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-376a9cea-0957-4baa-8928-c98c1749fb7b tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:30.053481 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-376a9cea-0957-4baa-8928-c98c1749fb7b tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] [instance: 16f28376-6e47-4237-98f2-4e60adaa04e2] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:30.060695 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-376a9cea-0957-4baa-8928-c98c1749fb7b tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:30.061156 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-376a9cea-0957-4baa-8928-c98c1749fb7b tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:30.061947 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-376a9cea-0957-4baa-8928-c98c1749fb7b tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:30.062373 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-376a9cea-0957-4baa-8928-c98c1749fb7b tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:30.210121 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-376a9cea-0957-4baa-8928-c98c1749fb7b tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4d3f0f79a043ffaa7882cf3ecfed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c4d5c13f3844eeb65d7aab9a1d5864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:30.218797 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-376a9cea-0957-4baa-8928-c98c1749fb7b tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] 10.222.0.58 "GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2" status: 200 len: 1314 microversion: 2.1 time: 0.170447 Jan 19 16:08:30.219474 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 519/972] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:30 2022] GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:08:31.240285 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ddff31ef-c42c-412c-a2cb-e03830c9d469 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:31.241411 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-ddff31ef-c42c-412c-a2cb-e03830c9d469 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] [instance: 16f28376-6e47-4237-98f2-4e60adaa04e2] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:31.254872 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ddff31ef-c42c-412c-a2cb-e03830c9d469 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:31.255793 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ddff31ef-c42c-412c-a2cb-e03830c9d469 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:31.257449 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ddff31ef-c42c-412c-a2cb-e03830c9d469 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:31.258206 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ddff31ef-c42c-412c-a2cb-e03830c9d469 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:31.433776 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ddff31ef-c42c-412c-a2cb-e03830c9d469 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4d3f0f79a043ffaa7882cf3ecfed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c4d5c13f3844eeb65d7aab9a1d5864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:31.441954 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-ddff31ef-c42c-412c-a2cb-e03830c9d469 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] 10.222.0.58 "GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2" status: 200 len: 1464 microversion: 2.1 time: 0.208533 Jan 19 16:08:31.442606 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 454/973] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:31 2022] GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2 => generated 1464 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:08:31.504323 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a4262748-b506-41e0-8042-e7077fe54ab2 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:31.505174 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a4262748-b506-41e0-8042-e7077fe54ab2 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] [instance: 16f28376-6e47-4237-98f2-4e60adaa04e2] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:31.517392 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a4262748-b506-41e0-8042-e7077fe54ab2 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:31.517864 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a4262748-b506-41e0-8042-e7077fe54ab2 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:31.519775 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a4262748-b506-41e0-8042-e7077fe54ab2 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:31.519775 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a4262748-b506-41e0-8042-e7077fe54ab2 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:31.561749 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a4262748-b506-41e0-8042-e7077fe54ab2 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] [instance: 16f28376-6e47-4237-98f2-4e60adaa04e2] Going to try to terminate instance {{(pid=128876) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:08:31.898221 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a4262748-b506-41e0-8042-e7077fe54ab2 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] 10.222.0.58 "DELETE /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2" status: 204 len: 0 microversion: 2.1 time: 0.402691 Jan 19 16:08:31.899241 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 520/974] 10.222.0.58 () {58 vars in 1238 bytes} [Wed Jan 19 16:08:31 2022] DELETE /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:08:31.908085 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-1ae0c97b-a82e-4574-a87b-942196c85f84 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:31.908710 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-1ae0c97b-a82e-4574-a87b-942196c85f84 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] [instance: 16f28376-6e47-4237-98f2-4e60adaa04e2] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:31.919094 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1ae0c97b-a82e-4574-a87b-942196c85f84 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:31.919837 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1ae0c97b-a82e-4574-a87b-942196c85f84 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:31.921182 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1ae0c97b-a82e-4574-a87b-942196c85f84 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:31.921876 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1ae0c97b-a82e-4574-a87b-942196c85f84 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:32.130418 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-1ae0c97b-a82e-4574-a87b-942196c85f84 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4d3f0f79a043ffaa7882cf3ecfed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c4d5c13f3844eeb65d7aab9a1d5864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:32.143526 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-1ae0c97b-a82e-4574-a87b-942196c85f84 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] 10.222.0.58 "GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2" status: 200 len: 1470 microversion: 2.1 time: 0.238924 Jan 19 16:08:32.144295 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 455/975] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:31 2022] GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2 => generated 1470 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:08:33.173469 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ad684107-b7c2-4803-ba89-6020b094bbf9 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:33.174403 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ad684107-b7c2-4803-ba89-6020b094bbf9 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] [instance: 16f28376-6e47-4237-98f2-4e60adaa04e2] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:33.182228 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ad684107-b7c2-4803-ba89-6020b094bbf9 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:33.182587 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ad684107-b7c2-4803-ba89-6020b094bbf9 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:33.183434 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ad684107-b7c2-4803-ba89-6020b094bbf9 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:33.183859 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ad684107-b7c2-4803-ba89-6020b094bbf9 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:33.395462 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ad684107-b7c2-4803-ba89-6020b094bbf9 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4d3f0f79a043ffaa7882cf3ecfed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c4d5c13f3844eeb65d7aab9a1d5864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:33.407703 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ad684107-b7c2-4803-ba89-6020b094bbf9 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] 10.222.0.58 "GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2" status: 200 len: 1470 microversion: 2.1 time: 0.238200 Jan 19 16:08:33.408723 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 521/976] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:33 2022] GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2 => generated 1470 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:08:34.427619 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-1709664a-22f5-4be4-8827-2ba6b85e9f71 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:34.429286 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-1709664a-22f5-4be4-8827-2ba6b85e9f71 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] [instance: 16f28376-6e47-4237-98f2-4e60adaa04e2] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:34.447047 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1709664a-22f5-4be4-8827-2ba6b85e9f71 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:34.447942 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1709664a-22f5-4be4-8827-2ba6b85e9f71 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:34.449490 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1709664a-22f5-4be4-8827-2ba6b85e9f71 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:34.450133 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1709664a-22f5-4be4-8827-2ba6b85e9f71 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:34.456139 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-319ca839-c3de-4c21-9219-3bef6ce886a0 req-0cccae75-abd5-4bd5-b4ad-b739319a5302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f28376-6e47-4237-98f2-4e60adaa04e2", "name": "network-vif-deleted", "tag": "2d7d2a7a-a8fe-48ee-b688-d5785b4405a7"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:08:34.458058 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:08:34.458058 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:08:34.481432 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-319ca839-c3de-4c21-9219-3bef6ce886a0 req-0cccae75-abd5-4bd5-b4ad-b739319a5302 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:34.482396 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-319ca839-c3de-4c21-9219-3bef6ce886a0 req-0cccae75-abd5-4bd5-b4ad-b739319a5302 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:34.507764 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-319ca839-c3de-4c21-9219-3bef6ce886a0 req-0cccae75-abd5-4bd5-b4ad-b739319a5302 service nova] Creating event network-vif-deleted:2d7d2a7a-a8fe-48ee-b688-d5785b4405a7 for instance 16f28376-6e47-4237-98f2-4e60adaa04e2 on hv-cinder-82002 Jan 19 16:08:34.518781 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-319ca839-c3de-4c21-9219-3bef6ce886a0 req-0cccae75-abd5-4bd5-b4ad-b739319a5302 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067042 Jan 19 16:08:34.528822 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 522/977] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:08:34.639122 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-1709664a-22f5-4be4-8827-2ba6b85e9f71 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4d3f0f79a043ffaa7882cf3ecfed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c4d5c13f3844eeb65d7aab9a1d5864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:34.655344 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-1709664a-22f5-4be4-8827-2ba6b85e9f71 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] 10.222.0.58 "GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2" status: 200 len: 1428 microversion: 2.1 time: 0.230682 Jan 19 16:08:34.656896 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 456/978] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:34 2022] GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2 => generated 1428 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:08:35.682873 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d5d76707-0fdc-4a27-ba90-2e50984102c7 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:35.684383 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-d5d76707-0fdc-4a27-ba90-2e50984102c7 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] [instance: 16f28376-6e47-4237-98f2-4e60adaa04e2] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:35.692455 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d5d76707-0fdc-4a27-ba90-2e50984102c7 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:35.694812 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d5d76707-0fdc-4a27-ba90-2e50984102c7 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:35.694812 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d5d76707-0fdc-4a27-ba90-2e50984102c7 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:35.694812 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d5d76707-0fdc-4a27-ba90-2e50984102c7 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:35.720735 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.wsgi [None req-d5d76707-0fdc-4a27-ba90-2e50984102c7 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] HTTP exception thrown: Instance 16f28376-6e47-4237-98f2-4e60adaa04e2 could not be found. Jan 19 16:08:35.721691 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d5d76707-0fdc-4a27-ba90-2e50984102c7 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] Returning 404 to user: Instance 16f28376-6e47-4237-98f2-4e60adaa04e2 could not be found. {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:08:35.722687 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-d5d76707-0fdc-4a27-ba90-2e50984102c7 tempest-VolumesNegativeTest-2129325839 tempest-VolumesNegativeTest-2129325839-project] 10.222.0.58 "GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2" status: 404 len: 111 microversion: 2.1 time: 0.044492 Jan 19 16:08:35.725730 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 523/979] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:35 2022] GET /compute/v2.1/servers/16f28376-6e47-4237-98f2-4e60adaa04e2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:08:47.772803 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-51effa76-579e-448d-87ed-d2d72d8bbb88 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:47.773637 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-51effa76-579e-448d-87ed-d2d72d8bbb88 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:47.782801 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-51effa76-579e-448d-87ed-d2d72d8bbb88 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:47.783358 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-51effa76-579e-448d-87ed-d2d72d8bbb88 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:47.784217 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-51effa76-579e-448d-87ed-d2d72d8bbb88 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:47.784663 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-51effa76-579e-448d-87ed-d2d72d8bbb88 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:47.870638 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.objects.instance [None req-51effa76-579e-448d-87ed-d2d72d8bbb88 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lazy-loading 'services' on Instance uuid a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a {{(pid=128875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:08:48.137467 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-51effa76-579e-448d-87ed-d2d72d8bbb88 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/os-volume_attachments/d10fafca-66f9-41c9-8847-2c1293426e03" status: 202 len: 0 microversion: 2.1 time: 0.599819 Jan 19 16:08:48.138055 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 457/980] 10.222.0.58 () {58 vars in 1415 bytes} [Wed Jan 19 16:08:47 2022] DELETE /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/os-volume_attachments/d10fafca-66f9-41c9-8847-2c1293426e03 => generated 0 bytes in 601 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:08:55.622902 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-bd8b8a92-00cc-4706-ab39-d73509ef1c7a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:08:55.629363 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bd8b8a92-00cc-4706-ab39-d73509ef1c7a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:55.629834 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bd8b8a92-00cc-4706-ab39-d73509ef1c7a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:55.695548 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-bd8b8a92-00cc-4706-ab39-d73509ef1c7a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Going to try to stop instance {{(pid=128876) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 19 16:08:55.906763 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-bd8b8a92-00cc-4706-ab39-d73509ef1c7a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 202 len: 0 microversion: 2.1 time: 0.287392 Jan 19 16:08:55.907299 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 524/981] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:08:55 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:08:55.918226 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-32f7f12e-9e23-41e6-9b81-d69b173f439f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:55.919298 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-32f7f12e-9e23-41e6-9b81-d69b173f439f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:55.926483 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-32f7f12e-9e23-41e6-9b81-d69b173f439f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:55.927517 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-32f7f12e-9e23-41e6-9b81-d69b173f439f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:55.927715 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-32f7f12e-9e23-41e6-9b81-d69b173f439f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:55.928144 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-32f7f12e-9e23-41e6-9b81-d69b173f439f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:56.076392 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-32f7f12e-9e23-41e6-9b81-d69b173f439f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:56.084142 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-32f7f12e-9e23-41e6-9b81-d69b173f439f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1678 microversion: 2.1 time: 0.171819 Jan 19 16:08:56.084717 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 458/982] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:55 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:08:57.102322 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-9283b93a-bde7-4414-bce2-9e8e6e739ea7 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:57.103070 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-9283b93a-bde7-4414-bce2-9e8e6e739ea7 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:57.109348 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9283b93a-bde7-4414-bce2-9e8e6e739ea7 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:57.109788 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9283b93a-bde7-4414-bce2-9e8e6e739ea7 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:57.110685 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9283b93a-bde7-4414-bce2-9e8e6e739ea7 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:57.111157 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9283b93a-bde7-4414-bce2-9e8e6e739ea7 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:57.410789 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-9283b93a-bde7-4414-bce2-9e8e6e739ea7 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:57.419007 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-9283b93a-bde7-4414-bce2-9e8e6e739ea7 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1678 microversion: 2.1 time: 0.321144 Jan 19 16:08:57.419623 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 525/983] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:57 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1678 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:08:58.436278 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-489361d7-68d6-46ca-b8f6-6a37aabd2131 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:58.436942 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-489361d7-68d6-46ca-b8f6-6a37aabd2131 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:58.443341 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-489361d7-68d6-46ca-b8f6-6a37aabd2131 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:58.443911 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-489361d7-68d6-46ca-b8f6-6a37aabd2131 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:58.444681 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-489361d7-68d6-46ca-b8f6-6a37aabd2131 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:58.445104 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-489361d7-68d6-46ca-b8f6-6a37aabd2131 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:58.581710 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-489361d7-68d6-46ca-b8f6-6a37aabd2131 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:58.587518 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-489361d7-68d6-46ca-b8f6-6a37aabd2131 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1678 microversion: 2.1 time: 0.154954 Jan 19 16:08:58.592325 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 459/984] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:58 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:08:59.605346 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-fd2eaacc-3529-4c72-b347-f9eff23bcf08 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:08:59.605883 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-fd2eaacc-3529-4c72-b347-f9eff23bcf08 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:08:59.612873 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fd2eaacc-3529-4c72-b347-f9eff23bcf08 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:59.613316 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fd2eaacc-3529-4c72-b347-f9eff23bcf08 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:59.614115 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fd2eaacc-3529-4c72-b347-f9eff23bcf08 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:08:59.614542 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fd2eaacc-3529-4c72-b347-f9eff23bcf08 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:08:59.757743 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-fd2eaacc-3529-4c72-b347-f9eff23bcf08 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:08:59.765311 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-fd2eaacc-3529-4c72-b347-f9eff23bcf08 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1678 microversion: 2.1 time: 0.164239 Jan 19 16:08:59.765889 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 526/985] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:08:59 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:09:00.782749 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-1b542131-da6f-4427-a7d7-4b0c970e727d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:00.783403 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-1b542131-da6f-4427-a7d7-4b0c970e727d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:00.790429 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1b542131-da6f-4427-a7d7-4b0c970e727d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:00.790873 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1b542131-da6f-4427-a7d7-4b0c970e727d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:00.791696 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1b542131-da6f-4427-a7d7-4b0c970e727d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:00.792154 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1b542131-da6f-4427-a7d7-4b0c970e727d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:00.931580 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-1b542131-da6f-4427-a7d7-4b0c970e727d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:00.939562 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-1b542131-da6f-4427-a7d7-4b0c970e727d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1678 microversion: 2.1 time: 0.160397 Jan 19 16:09:00.940219 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 460/986] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:00 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:09:01.957128 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e40dbcf7-7e74-4bcd-bdfb-0de93c305dc8 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:01.957782 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-e40dbcf7-7e74-4bcd-bdfb-0de93c305dc8 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:01.964535 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e40dbcf7-7e74-4bcd-bdfb-0de93c305dc8 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:01.964985 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e40dbcf7-7e74-4bcd-bdfb-0de93c305dc8 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:01.965777 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e40dbcf7-7e74-4bcd-bdfb-0de93c305dc8 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:01.966209 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e40dbcf7-7e74-4bcd-bdfb-0de93c305dc8 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:02.112091 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e40dbcf7-7e74-4bcd-bdfb-0de93c305dc8 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:02.126115 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e40dbcf7-7e74-4bcd-bdfb-0de93c305dc8 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1678 microversion: 2.1 time: 0.172711 Jan 19 16:09:02.126115 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 527/987] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:01 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:02.860606 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-3eaee8d4-27ba-4f70-a448-f1172eb86fe0 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:02.861177 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-3eaee8d4-27ba-4f70-a448-f1172eb86fe0 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:02.867835 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3eaee8d4-27ba-4f70-a448-f1172eb86fe0 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:02.868213 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3eaee8d4-27ba-4f70-a448-f1172eb86fe0 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:02.868995 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3eaee8d4-27ba-4f70-a448-f1172eb86fe0 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:02.869426 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3eaee8d4-27ba-4f70-a448-f1172eb86fe0 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:02.894823 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-3eaee8d4-27ba-4f70-a448-f1172eb86fe0 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Going to try to terminate instance {{(pid=128875) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:09:03.147417 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-1a53df68-5503-4e74-b7db-08f7cadda0e3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:03.148241 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-1a53df68-5503-4e74-b7db-08f7cadda0e3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:03.155101 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1a53df68-5503-4e74-b7db-08f7cadda0e3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:03.155551 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1a53df68-5503-4e74-b7db-08f7cadda0e3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:03.156358 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1a53df68-5503-4e74-b7db-08f7cadda0e3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:03.156826 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1a53df68-5503-4e74-b7db-08f7cadda0e3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:03.198878 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-3eaee8d4-27ba-4f70-a448-f1172eb86fe0 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 204 len: 0 microversion: 2.1 time: 0.341792 Jan 19 16:09:03.199504 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 461/988] 10.222.0.58 () {58 vars in 1238 bytes} [Wed Jan 19 16:09:02 2022] DELETE /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:09:03.208445 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e1006652-a319-4d44-bd8a-c563e9eea56b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:03.209383 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-e1006652-a319-4d44-bd8a-c563e9eea56b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:03.216038 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e1006652-a319-4d44-bd8a-c563e9eea56b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:03.220482 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e1006652-a319-4d44-bd8a-c563e9eea56b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:03.220482 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e1006652-a319-4d44-bd8a-c563e9eea56b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:03.220482 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e1006652-a319-4d44-bd8a-c563e9eea56b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:03.289642 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-1a53df68-5503-4e74-b7db-08f7cadda0e3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:03.297091 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-1a53df68-5503-4e74-b7db-08f7cadda0e3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1678 microversion: 2.1 time: 0.154497 Jan 19 16:09:03.297667 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 528/989] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:03 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:03.354561 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e1006652-a319-4d44-bd8a-c563e9eea56b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:03.362177 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e1006652-a319-4d44-bd8a-c563e9eea56b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1577 microversion: 2.1 time: 0.157948 Jan 19 16:09:03.362746 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 462/990] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:03 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:09:04.313403 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3b0a9c6b-ce40-43a8-99e6-a23851f6ebb4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:04.314056 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3b0a9c6b-ce40-43a8-99e6-a23851f6ebb4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:04.320403 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3b0a9c6b-ce40-43a8-99e6-a23851f6ebb4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:04.321485 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3b0a9c6b-ce40-43a8-99e6-a23851f6ebb4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:04.322270 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3b0a9c6b-ce40-43a8-99e6-a23851f6ebb4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:04.322702 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3b0a9c6b-ce40-43a8-99e6-a23851f6ebb4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:04.379494 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d160b5b0-aeec-4392-8db5-e1c72c554e64 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:04.380107 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d160b5b0-aeec-4392-8db5-e1c72c554e64 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:04.387462 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d160b5b0-aeec-4392-8db5-e1c72c554e64 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:04.387906 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d160b5b0-aeec-4392-8db5-e1c72c554e64 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:04.388698 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d160b5b0-aeec-4392-8db5-e1c72c554e64 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:04.389345 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d160b5b0-aeec-4392-8db5-e1c72c554e64 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:04.464372 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-3b0a9c6b-ce40-43a8-99e6-a23851f6ebb4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:04.471997 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3b0a9c6b-ce40-43a8-99e6-a23851f6ebb4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1678 microversion: 2.1 time: 0.162249 Jan 19 16:09:04.472568 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 529/991] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:04 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:04.529678 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d160b5b0-aeec-4392-8db5-e1c72c554e64 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:04.537215 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d160b5b0-aeec-4392-8db5-e1c72c554e64 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1577 microversion: 2.1 time: 0.162272 Jan 19 16:09:04.537794 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 463/992] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:04 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:09:05.489153 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ebbea0d1-58e7-44d9-b3d9-e497cf784a2a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:05.489788 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ebbea0d1-58e7-44d9-b3d9-e497cf784a2a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:05.496711 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ebbea0d1-58e7-44d9-b3d9-e497cf784a2a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:05.497184 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ebbea0d1-58e7-44d9-b3d9-e497cf784a2a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:05.497975 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ebbea0d1-58e7-44d9-b3d9-e497cf784a2a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:05.498406 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ebbea0d1-58e7-44d9-b3d9-e497cf784a2a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:05.553423 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-8186acb1-7d03-418c-b71d-4b1738d02fa6 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:05.554460 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8186acb1-7d03-418c-b71d-4b1738d02fa6 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:05.561539 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8186acb1-7d03-418c-b71d-4b1738d02fa6 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:05.561981 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8186acb1-7d03-418c-b71d-4b1738d02fa6 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:05.562772 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8186acb1-7d03-418c-b71d-4b1738d02fa6 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:05.563414 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8186acb1-7d03-418c-b71d-4b1738d02fa6 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:05.633098 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ebbea0d1-58e7-44d9-b3d9-e497cf784a2a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:05.640738 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ebbea0d1-58e7-44d9-b3d9-e497cf784a2a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1678 microversion: 2.1 time: 0.155383 Jan 19 16:09:05.641503 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 530/993] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:05 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:05.712758 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8186acb1-7d03-418c-b71d-4b1738d02fa6 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:05.725363 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-8186acb1-7d03-418c-b71d-4b1738d02fa6 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1577 microversion: 2.1 time: 0.175256 Jan 19 16:09:05.726409 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 464/994] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:05 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:09:06.658339 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-df7db633-60e5-4e58-8eed-538ef854e775 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:06.658934 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-df7db633-60e5-4e58-8eed-538ef854e775 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:06.665917 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-df7db633-60e5-4e58-8eed-538ef854e775 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:06.666453 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-df7db633-60e5-4e58-8eed-538ef854e775 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:06.667262 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-df7db633-60e5-4e58-8eed-538ef854e775 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:06.667698 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-df7db633-60e5-4e58-8eed-538ef854e775 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:06.742536 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-2201dca0-634b-4c1f-aa65-664fee219238 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:06.743171 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-2201dca0-634b-4c1f-aa65-664fee219238 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:06.749427 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2201dca0-634b-4c1f-aa65-664fee219238 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:06.749868 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2201dca0-634b-4c1f-aa65-664fee219238 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:06.750639 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2201dca0-634b-4c1f-aa65-664fee219238 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:06.751089 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2201dca0-634b-4c1f-aa65-664fee219238 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:06.799611 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-df7db633-60e5-4e58-8eed-538ef854e775 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:06.807592 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-df7db633-60e5-4e58-8eed-538ef854e775 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1678 microversion: 2.1 time: 0.152925 Jan 19 16:09:06.808214 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 531/995] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:06 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:06.907179 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-2201dca0-634b-4c1f-aa65-664fee219238 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:06.912787 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-2201dca0-634b-4c1f-aa65-664fee219238 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1577 microversion: 2.1 time: 0.173958 Jan 19 16:09:06.913370 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 465/996] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:06 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:09:07.825048 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-cd1781b1-5461-4cb9-8f83-ade56ed0e276 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:07.825645 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-cd1781b1-5461-4cb9-8f83-ade56ed0e276 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:07.831995 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cd1781b1-5461-4cb9-8f83-ade56ed0e276 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:07.832469 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cd1781b1-5461-4cb9-8f83-ade56ed0e276 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:07.833248 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cd1781b1-5461-4cb9-8f83-ade56ed0e276 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:07.833674 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cd1781b1-5461-4cb9-8f83-ade56ed0e276 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:07.930753 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-5efdd90d-5505-4e0d-bcbb-b9ba2dbc768c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:07.935107 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-5efdd90d-5505-4e0d-bcbb-b9ba2dbc768c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:07.937916 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5efdd90d-5505-4e0d-bcbb-b9ba2dbc768c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:07.938364 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5efdd90d-5505-4e0d-bcbb-b9ba2dbc768c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:07.939223 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5efdd90d-5505-4e0d-bcbb-b9ba2dbc768c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:07.939660 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5efdd90d-5505-4e0d-bcbb-b9ba2dbc768c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:07.977751 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-cd1781b1-5461-4cb9-8f83-ade56ed0e276 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:07.985321 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-cd1781b1-5461-4cb9-8f83-ade56ed0e276 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1678 microversion: 2.1 time: 0.164011 Jan 19 16:09:07.985893 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 532/997] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:07 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:08.157001 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-5efdd90d-5505-4e0d-bcbb-b9ba2dbc768c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:08.165164 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-5efdd90d-5505-4e0d-bcbb-b9ba2dbc768c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1577 microversion: 2.1 time: 0.239123 Jan 19 16:09:08.165832 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 466/998] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:07 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1577 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:09:09.003144 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-1eeb7bac-fd63-4d8a-a6f9-4c862d1a696b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:09.003970 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-1eeb7bac-fd63-4d8a-a6f9-4c862d1a696b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:09.013169 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1eeb7bac-fd63-4d8a-a6f9-4c862d1a696b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:09.013699 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1eeb7bac-fd63-4d8a-a6f9-4c862d1a696b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:09.014581 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1eeb7bac-fd63-4d8a-a6f9-4c862d1a696b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:09.015035 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1eeb7bac-fd63-4d8a-a6f9-4c862d1a696b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:09.182540 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-32bacf69-87c2-47dd-8d99-f306f005a194 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:09.183481 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-32bacf69-87c2-47dd-8d99-f306f005a194 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:09.196572 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-32bacf69-87c2-47dd-8d99-f306f005a194 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:09.200478 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-32bacf69-87c2-47dd-8d99-f306f005a194 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:09.201622 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-32bacf69-87c2-47dd-8d99-f306f005a194 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:09.203664 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-32bacf69-87c2-47dd-8d99-f306f005a194 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:09.223809 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-1eeb7bac-fd63-4d8a-a6f9-4c862d1a696b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:09.238421 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-1eeb7bac-fd63-4d8a-a6f9-4c862d1a696b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1678 microversion: 2.1 time: 0.239141 Jan 19 16:09:09.239547 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 533/999] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:08 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1678 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:09.330496 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-32bacf69-87c2-47dd-8d99-f306f005a194 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:09.339349 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-32bacf69-87c2-47dd-8d99-f306f005a194 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1510 microversion: 2.1 time: 0.160901 Jan 19 16:09:09.340417 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 467/1000] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:09 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:09.406768 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-9f88f83a-50ee-4b5e-82ae-9d6d61a9e928 req-bafc3229-d10a-4728-803f-e46ebf8c6dfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a199868-949d-49fb-96e3-8c0befc8e20b", "name": "network-vif-deleted", "tag": "31d41df4-bb41-486f-bc2f-3fbe182757f0"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:09:09.408738 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:09:09.408738 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:09:09.415707 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-9f88f83a-50ee-4b5e-82ae-9d6d61a9e928 req-bafc3229-d10a-4728-803f-e46ebf8c6dfb service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:09.416149 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-9f88f83a-50ee-4b5e-82ae-9d6d61a9e928 req-bafc3229-d10a-4728-803f-e46ebf8c6dfb service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:09.427778 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-9f88f83a-50ee-4b5e-82ae-9d6d61a9e928 req-bafc3229-d10a-4728-803f-e46ebf8c6dfb service nova] Creating event network-vif-deleted:31d41df4-bb41-486f-bc2f-3fbe182757f0 for instance 2a199868-949d-49fb-96e3-8c0befc8e20b on hv-cinder-82002 Jan 19 16:09:09.433883 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-9f88f83a-50ee-4b5e-82ae-9d6d61a9e928 req-bafc3229-d10a-4728-803f-e46ebf8c6dfb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030884 Jan 19 16:09:09.434460 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 534/1001] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:09:10.259657 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d2da324c-c769-4f73-b578-65113e8fef4c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:10.260599 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d2da324c-c769-4f73-b578-65113e8fef4c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:10.267176 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d2da324c-c769-4f73-b578-65113e8fef4c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:10.267637 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d2da324c-c769-4f73-b578-65113e8fef4c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:10.272619 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d2da324c-c769-4f73-b578-65113e8fef4c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:10.272619 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d2da324c-c769-4f73-b578-65113e8fef4c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:10.362225 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-93eaf0e6-4dff-4a81-8dff-862026540dbe tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:10.368105 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-93eaf0e6-4dff-4a81-8dff-862026540dbe tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:10.387220 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-93eaf0e6-4dff-4a81-8dff-862026540dbe tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:10.393715 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-93eaf0e6-4dff-4a81-8dff-862026540dbe tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:10.400986 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-93eaf0e6-4dff-4a81-8dff-862026540dbe tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:10.402076 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-93eaf0e6-4dff-4a81-8dff-862026540dbe tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:10.477422 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-93eaf0e6-4dff-4a81-8dff-862026540dbe tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:10.480732 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-93eaf0e6-4dff-4a81-8dff-862026540dbe tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:10.481167 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.objects.instance [None req-93eaf0e6-4dff-4a81-8dff-862026540dbe tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lazy-loading 'fault' on Instance uuid 2a199868-949d-49fb-96e3-8c0befc8e20b {{(pid=128876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:09:10.550125 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-93eaf0e6-4dff-4a81-8dff-862026540dbe tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:10.557594 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d2da324c-c769-4f73-b578-65113e8fef4c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:10.562439 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-93eaf0e6-4dff-4a81-8dff-862026540dbe tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 200 len: 1230 microversion: 2.1 time: 0.207894 Jan 19 16:09:10.568643 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 535/1002] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:10 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 1230 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:10.569755 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d2da324c-c769-4f73-b578-65113e8fef4c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1678 microversion: 2.1 time: 0.314741 Jan 19 16:09:10.571202 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 468/1003] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:10 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1678 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:11.581343 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a44f0525-c15c-4ac0-8072-f83d3069924f tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:11.582706 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a44f0525-c15c-4ac0-8072-f83d3069924f tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:11.591731 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ff353420-3c71-4b65-a2ec-ae478dbcd3f8 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:11.592374 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-ff353420-3c71-4b65-a2ec-ae478dbcd3f8 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:11.598100 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a44f0525-c15c-4ac0-8072-f83d3069924f tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:11.598561 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a44f0525-c15c-4ac0-8072-f83d3069924f tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:11.599412 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a44f0525-c15c-4ac0-8072-f83d3069924f tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:11.600205 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a44f0525-c15c-4ac0-8072-f83d3069924f tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:11.602963 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ff353420-3c71-4b65-a2ec-ae478dbcd3f8 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:11.603827 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ff353420-3c71-4b65-a2ec-ae478dbcd3f8 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:11.605286 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ff353420-3c71-4b65-a2ec-ae478dbcd3f8 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:11.605972 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ff353420-3c71-4b65-a2ec-ae478dbcd3f8 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:11.621121 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.wsgi [None req-a44f0525-c15c-4ac0-8072-f83d3069924f tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] HTTP exception thrown: Instance 2a199868-949d-49fb-96e3-8c0befc8e20b could not be found. Jan 19 16:09:11.622046 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a44f0525-c15c-4ac0-8072-f83d3069924f tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Returning 404 to user: Instance 2a199868-949d-49fb-96e3-8c0befc8e20b could not be found. {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:09:11.623374 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a44f0525-c15c-4ac0-8072-f83d3069924f tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 404 len: 111 microversion: 2.1 time: 0.045536 Jan 19 16:09:11.633605 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 536/1004] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:11 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:09:11.810052 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-2bc2cba5-ef28-479d-844f-bb2c3c9b799c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1177741551", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1630068289", "security_groups": [{"name": "tempest-secgroup-smoke-364405160"}], "block_device_mapping_v2": [{"uuid": "0edf87cf-f4af-45e4-8536-eb0bd6710999", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "59d48545-e392-481c-8443-e9229e177c3f"}]}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:09:11.892314 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ff353420-3c71-4b65-a2ec-ae478dbcd3f8 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:11.910339 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-ff353420-3c71-4b65-a2ec-ae478dbcd3f8 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1655 microversion: 2.1 time: 0.322662 Jan 19 16:09:11.911243 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 469/1005] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:11 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1655 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:09:11.939237 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-8ccf0cb6-3ca8-4992-92cc-27957eaa9ebf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:09:11.945844 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8ccf0cb6-3ca8-4992-92cc-27957eaa9ebf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:11.946476 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8ccf0cb6-3ca8-4992-92cc-27957eaa9ebf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:11.978333 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8ccf0cb6-3ca8-4992-92cc-27957eaa9ebf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Going to try to start instance {{(pid=128875) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 19 16:09:11.980216 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.network.neutron [None req-2bc2cba5-ef28-479d-844f-bb2c3c9b799c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] validate_networks() for [('59d48545-e392-481c-8443-e9229e177c3f', None, None, None, None, None)] {{(pid=128876) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:09:12.233684 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-8ccf0cb6-3ca8-4992-92cc-27957eaa9ebf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action" status: 202 len: 0 microversion: 2.1 time: 0.298258 Jan 19 16:09:12.234401 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 470/1006] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:09:11 2022] POST /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:09:12.248354 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-8eaac9ae-ee8b-4dcd-ae6e-458c81255682 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:12.249572 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8eaac9ae-ee8b-4dcd-ae6e-458c81255682 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:12.259419 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8eaac9ae-ee8b-4dcd-ae6e-458c81255682 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:12.260017 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8eaac9ae-ee8b-4dcd-ae6e-458c81255682 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:12.261332 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8eaac9ae-ee8b-4dcd-ae6e-458c81255682 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:12.262047 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8eaac9ae-ee8b-4dcd-ae6e-458c81255682 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:12.440987 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8eaac9ae-ee8b-4dcd-ae6e-458c81255682 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:12.449279 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-8eaac9ae-ee8b-4dcd-ae6e-458c81255682 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1664 microversion: 2.1 time: 0.208386 Jan 19 16:09:12.455397 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 471/1007] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:12 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1664 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:09:12.565483 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-2bc2cba5-ef28-479d-844f-bb2c3c9b799c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Flavor limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:09:12.565906 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-2bc2cba5-ef28-479d-844f-bb2c3c9b799c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Image limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:09:12.566376 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-2bc2cba5-ef28-479d-844f-bb2c3c9b799c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Flavor pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:09:12.566779 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-2bc2cba5-ef28-479d-844f-bb2c3c9b799c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Image pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:09:12.567219 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-2bc2cba5-ef28-479d-844f-bb2c3c9b799c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:09:12.577239 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2bc2cba5-ef28-479d-844f-bb2c3c9b799c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:12.577678 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2bc2cba5-ef28-479d-844f-bb2c3c9b799c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:12.578513 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2bc2cba5-ef28-479d-844f-bb2c3c9b799c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:12.578944 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2bc2cba5-ef28-479d-844f-bb2c3c9b799c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:12.599738 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-2bc2cba5-ef28-479d-844f-bb2c3c9b799c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Getting quotas for project ee1086833404449a901e9a13cc93c8b5. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:09:12.609263 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-2bc2cba5-ef28-479d-844f-bb2c3c9b799c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Getting quotas for user 054c8acefa4240469678db612ea73c33 and project ee1086833404449a901e9a13cc93c8b5. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:09:12.693062 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-2bc2cba5-ef28-479d-844f-bb2c3c9b799c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Going to run 1 instances... {{(pid=128876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:09:12.695254 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-2bc2cba5-ef28-479d-844f-bb2c3c9b799c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0edf87cf-f4af-45e4-8536-eb0bd6710999',volume_size=None,volume_type=None)] {{(pid=128876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:09:13.213721 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-2bc2cba5-ef28-479d-844f-bb2c3c9b799c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.408574 Jan 19 16:09:13.214424 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 537/1008] 10.222.0.58 () {60 vars in 1146 bytes} [Wed Jan 19 16:09:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 1410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:09:13.225085 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6de69b8f-6984-4cb3-8376-de7f0defbe5c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:13.225722 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-6de69b8f-6984-4cb3-8376-de7f0defbe5c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:13.283127 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6de69b8f-6984-4cb3-8376-de7f0defbe5c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:13.290363 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6de69b8f-6984-4cb3-8376-de7f0defbe5c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1095 microversion: 2.1 time: 0.068885 Jan 19 16:09:13.291408 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 472/1009] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:13 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:13.465747 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-598ad8e5-1e33-4c20-a702-155bd32bedd4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:13.466477 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-598ad8e5-1e33-4c20-a702-155bd32bedd4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:13.473170 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-598ad8e5-1e33-4c20-a702-155bd32bedd4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:13.473619 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-598ad8e5-1e33-4c20-a702-155bd32bedd4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:13.474419 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-598ad8e5-1e33-4c20-a702-155bd32bedd4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:13.474860 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-598ad8e5-1e33-4c20-a702-155bd32bedd4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:13.719420 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-598ad8e5-1e33-4c20-a702-155bd32bedd4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:13.719420 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-598ad8e5-1e33-4c20-a702-155bd32bedd4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1664 microversion: 2.1 time: 0.163962 Jan 19 16:09:13.719420 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 538/1010] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:13 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1664 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:13.940493 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:09:13.940743 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: Wed Jan 19 16:09:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 16:09:14.307408 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6211be3d-763f-41f8-8f0e-af70c0a83c99 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:14.308046 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-6211be3d-763f-41f8-8f0e-af70c0a83c99 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:14.315153 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6211be3d-763f-41f8-8f0e-af70c0a83c99 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:14.315600 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6211be3d-763f-41f8-8f0e-af70c0a83c99 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:14.316452 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6211be3d-763f-41f8-8f0e-af70c0a83c99 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:14.316888 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6211be3d-763f-41f8-8f0e-af70c0a83c99 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:14.376143 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6211be3d-763f-41f8-8f0e-af70c0a83c99 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:14.383945 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6211be3d-763f-41f8-8f0e-af70c0a83c99 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1145 microversion: 2.1 time: 0.079985 Jan 19 16:09:14.384513 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 473/1011] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:14 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:14.645855 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-1ced9c23-c9e4-4b56-8b52-a0372cbe8b4e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:14.646492 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-1ced9c23-c9e4-4b56-8b52-a0372cbe8b4e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:14.652932 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1ced9c23-c9e4-4b56-8b52-a0372cbe8b4e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:14.653398 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1ced9c23-c9e4-4b56-8b52-a0372cbe8b4e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:14.654231 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1ced9c23-c9e4-4b56-8b52-a0372cbe8b4e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:14.654661 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1ced9c23-c9e4-4b56-8b52-a0372cbe8b4e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:14.800696 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-1ced9c23-c9e4-4b56-8b52-a0372cbe8b4e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:14.809725 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-1ced9c23-c9e4-4b56-8b52-a0372cbe8b4e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1664 microversion: 2.1 time: 0.167696 Jan 19 16:09:14.810767 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 539/1012] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:14 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1664 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:15.401563 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6fedd141-1187-443e-a196-be874223ce5b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:15.402125 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-6fedd141-1187-443e-a196-be874223ce5b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:15.408697 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6fedd141-1187-443e-a196-be874223ce5b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:15.409157 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6fedd141-1187-443e-a196-be874223ce5b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:15.409944 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6fedd141-1187-443e-a196-be874223ce5b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:15.410378 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6fedd141-1187-443e-a196-be874223ce5b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:15.471618 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6fedd141-1187-443e-a196-be874223ce5b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:15.478851 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6fedd141-1187-443e-a196-be874223ce5b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1193 microversion: 2.1 time: 0.081936 Jan 19 16:09:15.479448 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 474/1013] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:15 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1193 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:15.827962 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b2b3b116-d81d-4b06-b7af-7572dd1e1dab tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:15.832854 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b2b3b116-d81d-4b06-b7af-7572dd1e1dab tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:15.835120 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b2b3b116-d81d-4b06-b7af-7572dd1e1dab tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:15.835676 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b2b3b116-d81d-4b06-b7af-7572dd1e1dab tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:15.836588 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b2b3b116-d81d-4b06-b7af-7572dd1e1dab tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:15.837159 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b2b3b116-d81d-4b06-b7af-7572dd1e1dab tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:15.967511 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-b2b3b116-d81d-4b06-b7af-7572dd1e1dab tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:15.975216 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b2b3b116-d81d-4b06-b7af-7572dd1e1dab tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1664 microversion: 2.1 time: 0.151502 Jan 19 16:09:15.979448 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 540/1014] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:15 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1664 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:16.495974 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e423bed0-893f-4ee7-b814-57a1c051a8cc tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:16.496542 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-e423bed0-893f-4ee7-b814-57a1c051a8cc tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:16.503156 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e423bed0-893f-4ee7-b814-57a1c051a8cc tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:16.503600 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e423bed0-893f-4ee7-b814-57a1c051a8cc tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:16.504426 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e423bed0-893f-4ee7-b814-57a1c051a8cc tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:16.504853 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e423bed0-893f-4ee7-b814-57a1c051a8cc tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:16.731545 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e423bed0-893f-4ee7-b814-57a1c051a8cc tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:16.738902 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e423bed0-893f-4ee7-b814-57a1c051a8cc tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1278 microversion: 2.1 time: 0.246861 Jan 19 16:09:16.739544 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 475/1015] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:16 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1278 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:16.993381 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e61dad28-9640-4f70-8742-9e0408bfa7a1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:16.993980 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-e61dad28-9640-4f70-8742-9e0408bfa7a1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:17.000355 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e61dad28-9640-4f70-8742-9e0408bfa7a1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:17.000793 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e61dad28-9640-4f70-8742-9e0408bfa7a1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:17.001560 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e61dad28-9640-4f70-8742-9e0408bfa7a1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:17.001985 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e61dad28-9640-4f70-8742-9e0408bfa7a1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:17.143122 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-e61dad28-9640-4f70-8742-9e0408bfa7a1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:17.151877 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e61dad28-9640-4f70-8742-9e0408bfa7a1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1668 microversion: 2.1 time: 0.162654 Jan 19 16:09:17.153201 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 541/1016] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:16 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:17.402217 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-7cb99990-019f-4dd7-8409-b82257b281b5 req-95ebd0c6-7a87-482c-afdd-5070513b5fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e083a930-0680-4dbf-833e-d1bde6998d1f", "tag": "986e2677-0e75-42ab-a7e2-6b6a21c582d0"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:09:17.404093 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:09:17.404093 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:09:17.411345 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-7cb99990-019f-4dd7-8409-b82257b281b5 req-95ebd0c6-7a87-482c-afdd-5070513b5fb0 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:17.412308 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-7cb99990-019f-4dd7-8409-b82257b281b5 req-95ebd0c6-7a87-482c-afdd-5070513b5fb0 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:17.424759 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-7cb99990-019f-4dd7-8409-b82257b281b5 req-95ebd0c6-7a87-482c-afdd-5070513b5fb0 service nova] Creating event network-changed:986e2677-0e75-42ab-a7e2-6b6a21c582d0 for instance e083a930-0680-4dbf-833e-d1bde6998d1f on hv-cinder-82002 Jan 19 16:09:17.429147 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-7cb99990-019f-4dd7-8409-b82257b281b5 req-95ebd0c6-7a87-482c-afdd-5070513b5fb0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031170 Jan 19 16:09:17.431138 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 476/1017] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:09:17.760613 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-0d9343d5-b30e-439a-9596-225fb977f976 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:17.761934 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-0d9343d5-b30e-439a-9596-225fb977f976 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:17.770238 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0d9343d5-b30e-439a-9596-225fb977f976 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:17.770860 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0d9343d5-b30e-439a-9596-225fb977f976 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:17.772413 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0d9343d5-b30e-439a-9596-225fb977f976 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:17.773096 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0d9343d5-b30e-439a-9596-225fb977f976 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:17.926507 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-0d9343d5-b30e-439a-9596-225fb977f976 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:17.934430 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-0d9343d5-b30e-439a-9596-225fb977f976 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1278 microversion: 2.1 time: 0.178631 Jan 19 16:09:17.935048 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 542/1018] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:17 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:18.951503 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-05670dcb-6415-41cc-ac07-07f1f7970d41 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:18.952153 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-05670dcb-6415-41cc-ac07-07f1f7970d41 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:18.959041 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-05670dcb-6415-41cc-ac07-07f1f7970d41 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:18.959483 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-05670dcb-6415-41cc-ac07-07f1f7970d41 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:18.960274 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-05670dcb-6415-41cc-ac07-07f1f7970d41 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:18.960697 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-05670dcb-6415-41cc-ac07-07f1f7970d41 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:19.098813 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-05670dcb-6415-41cc-ac07-07f1f7970d41 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:19.108206 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-05670dcb-6415-41cc-ac07-07f1f7970d41 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1278 microversion: 2.1 time: 0.161464 Jan 19 16:09:19.109229 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 477/1019] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:18 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:20.351882 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a389f083-4832-4076-a813-cb9fd05f9744 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:20.353019 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a389f083-4832-4076-a813-cb9fd05f9744 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:20.359155 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a389f083-4832-4076-a813-cb9fd05f9744 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:20.359605 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a389f083-4832-4076-a813-cb9fd05f9744 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:20.360401 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a389f083-4832-4076-a813-cb9fd05f9744 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:20.360817 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a389f083-4832-4076-a813-cb9fd05f9744 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:20.498313 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a389f083-4832-4076-a813-cb9fd05f9744 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:20.505805 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a389f083-4832-4076-a813-cb9fd05f9744 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1278 microversion: 2.1 time: 0.384503 Jan 19 16:09:20.506363 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 543/1020] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:20 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1278 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:21.521863 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e0c2996d-c59d-403d-a712-75b7c225b6bb tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:21.522404 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-e0c2996d-c59d-403d-a712-75b7c225b6bb tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:21.528881 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e0c2996d-c59d-403d-a712-75b7c225b6bb tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:21.529323 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e0c2996d-c59d-403d-a712-75b7c225b6bb tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:21.530108 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e0c2996d-c59d-403d-a712-75b7c225b6bb tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:21.530539 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e0c2996d-c59d-403d-a712-75b7c225b6bb tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:21.671966 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e0c2996d-c59d-403d-a712-75b7c225b6bb tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:21.679815 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e0c2996d-c59d-403d-a712-75b7c225b6bb tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1266 microversion: 2.1 time: 0.161419 Jan 19 16:09:21.680438 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 478/1021] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:21 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:22.697924 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5b481b38-e270-431e-b95b-dfd3205b68ce tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:22.698531 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5b481b38-e270-431e-b95b-dfd3205b68ce tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:22.705453 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5b481b38-e270-431e-b95b-dfd3205b68ce tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:22.709364 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5b481b38-e270-431e-b95b-dfd3205b68ce tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:22.709364 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5b481b38-e270-431e-b95b-dfd3205b68ce tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:22.709364 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5b481b38-e270-431e-b95b-dfd3205b68ce tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:22.858331 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5b481b38-e270-431e-b95b-dfd3205b68ce tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:22.865965 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5b481b38-e270-431e-b95b-dfd3205b68ce tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1266 microversion: 2.1 time: 0.172376 Jan 19 16:09:22.866554 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 544/1022] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:22 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:23.882918 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-0c1e5031-b8bf-4594-b5ff-f3008921fdd3 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:23.883489 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-0c1e5031-b8bf-4594-b5ff-f3008921fdd3 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:23.889866 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0c1e5031-b8bf-4594-b5ff-f3008921fdd3 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:23.893098 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0c1e5031-b8bf-4594-b5ff-f3008921fdd3 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:23.893098 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0c1e5031-b8bf-4594-b5ff-f3008921fdd3 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:23.893098 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0c1e5031-b8bf-4594-b5ff-f3008921fdd3 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:24.027916 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-0c1e5031-b8bf-4594-b5ff-f3008921fdd3 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:24.035544 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-0c1e5031-b8bf-4594-b5ff-f3008921fdd3 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1266 microversion: 2.1 time: 0.156553 Jan 19 16:09:24.036115 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 479/1023] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:23 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:25.052503 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-0beae68f-1f48-4799-929c-2fe6f93d1d04 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:25.053140 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-0beae68f-1f48-4799-929c-2fe6f93d1d04 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:25.060453 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0beae68f-1f48-4799-929c-2fe6f93d1d04 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:25.060904 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0beae68f-1f48-4799-929c-2fe6f93d1d04 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:25.061696 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0beae68f-1f48-4799-929c-2fe6f93d1d04 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:25.062128 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0beae68f-1f48-4799-929c-2fe6f93d1d04 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:25.201080 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-0beae68f-1f48-4799-929c-2fe6f93d1d04 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:25.208499 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-0beae68f-1f48-4799-929c-2fe6f93d1d04 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1266 microversion: 2.1 time: 0.159660 Jan 19 16:09:25.209078 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 545/1024] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:25 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:09:26.226183 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-8aa8e904-0344-4a84-adfb-ff563ea934b2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:26.226819 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8aa8e904-0344-4a84-adfb-ff563ea934b2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:26.233378 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8aa8e904-0344-4a84-adfb-ff563ea934b2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:26.233855 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8aa8e904-0344-4a84-adfb-ff563ea934b2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:26.234623 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8aa8e904-0344-4a84-adfb-ff563ea934b2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:26.235081 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8aa8e904-0344-4a84-adfb-ff563ea934b2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:26.377086 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8aa8e904-0344-4a84-adfb-ff563ea934b2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:26.385303 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-8aa8e904-0344-4a84-adfb-ff563ea934b2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1266 microversion: 2.1 time: 0.163063 Jan 19 16:09:26.385880 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 480/1025] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:26 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:27.402635 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f3bd1a8c-f348-4e36-a688-cb43a3c1265b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:27.403315 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f3bd1a8c-f348-4e36-a688-cb43a3c1265b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:27.409242 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f3bd1a8c-f348-4e36-a688-cb43a3c1265b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:27.409682 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f3bd1a8c-f348-4e36-a688-cb43a3c1265b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:27.410461 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f3bd1a8c-f348-4e36-a688-cb43a3c1265b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:27.410889 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f3bd1a8c-f348-4e36-a688-cb43a3c1265b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:27.543306 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f3bd1a8c-f348-4e36-a688-cb43a3c1265b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:27.550623 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f3bd1a8c-f348-4e36-a688-cb43a3c1265b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1266 microversion: 2.1 time: 0.152363 Jan 19 16:09:27.551215 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 546/1026] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:27 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:28.566875 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-b8423ede-fbb5-46b6-9487-6413d8b6fd0a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:28.567503 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-b8423ede-fbb5-46b6-9487-6413d8b6fd0a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:28.574021 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b8423ede-fbb5-46b6-9487-6413d8b6fd0a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:28.574465 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b8423ede-fbb5-46b6-9487-6413d8b6fd0a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:28.575307 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b8423ede-fbb5-46b6-9487-6413d8b6fd0a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:28.575747 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b8423ede-fbb5-46b6-9487-6413d8b6fd0a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:28.714366 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-b8423ede-fbb5-46b6-9487-6413d8b6fd0a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:28.722085 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-b8423ede-fbb5-46b6-9487-6413d8b6fd0a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1266 microversion: 2.1 time: 0.158938 Jan 19 16:09:28.722652 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 481/1027] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:28 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:29.738407 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-1ab27376-ddd8-4d9c-8ca6-dc13b85c5b51 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:29.739071 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-1ab27376-ddd8-4d9c-8ca6-dc13b85c5b51 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:29.745561 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1ab27376-ddd8-4d9c-8ca6-dc13b85c5b51 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:29.746047 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1ab27376-ddd8-4d9c-8ca6-dc13b85c5b51 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:29.746838 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1ab27376-ddd8-4d9c-8ca6-dc13b85c5b51 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:29.747295 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1ab27376-ddd8-4d9c-8ca6-dc13b85c5b51 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:30.108647 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-1ab27376-ddd8-4d9c-8ca6-dc13b85c5b51 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:30.116265 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-1ab27376-ddd8-4d9c-8ca6-dc13b85c5b51 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1266 microversion: 2.1 time: 0.381381 Jan 19 16:09:30.116929 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 547/1028] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:29 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1266 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:31.135180 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-83dd8d1d-6a2f-485b-92d7-2d6efe55e23f tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:31.135180 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-83dd8d1d-6a2f-485b-92d7-2d6efe55e23f tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:31.140512 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-83dd8d1d-6a2f-485b-92d7-2d6efe55e23f tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:31.140960 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-83dd8d1d-6a2f-485b-92d7-2d6efe55e23f tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:31.141726 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-83dd8d1d-6a2f-485b-92d7-2d6efe55e23f tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:31.142163 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-83dd8d1d-6a2f-485b-92d7-2d6efe55e23f tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:31.289193 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-83dd8d1d-6a2f-485b-92d7-2d6efe55e23f tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:31.297968 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-83dd8d1d-6a2f-485b-92d7-2d6efe55e23f tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1266 microversion: 2.1 time: 0.168097 Jan 19 16:09:31.298530 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 482/1029] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:31 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:32.314380 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-44696a47-b0e5-472a-9dc3-7999a19a5550 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:32.315060 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-44696a47-b0e5-472a-9dc3-7999a19a5550 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:32.321419 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-44696a47-b0e5-472a-9dc3-7999a19a5550 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:32.321861 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-44696a47-b0e5-472a-9dc3-7999a19a5550 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:32.322693 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-44696a47-b0e5-472a-9dc3-7999a19a5550 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:32.323155 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-44696a47-b0e5-472a-9dc3-7999a19a5550 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:32.456091 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-44696a47-b0e5-472a-9dc3-7999a19a5550 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:32.464539 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-44696a47-b0e5-472a-9dc3-7999a19a5550 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1266 microversion: 2.1 time: 0.153788 Jan 19 16:09:32.465131 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 548/1030] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:32 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:32.527605 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-dd766ade-0216-46b6-a42d-2c86e0a0ad74 req-aeee52c6-5022-4091-b32d-4db7a4ffe3c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e083a930-0680-4dbf-833e-d1bde6998d1f", "name": "network-vif-plugged", "status": "completed", "tag": "986e2677-0e75-42ab-a7e2-6b6a21c582d0"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:09:32.529192 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:09:32.529192 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:09:32.536609 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-dd766ade-0216-46b6-a42d-2c86e0a0ad74 req-aeee52c6-5022-4091-b32d-4db7a4ffe3c8 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:32.537829 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-dd766ade-0216-46b6-a42d-2c86e0a0ad74 req-aeee52c6-5022-4091-b32d-4db7a4ffe3c8 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:32.548165 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-dd766ade-0216-46b6-a42d-2c86e0a0ad74 req-aeee52c6-5022-4091-b32d-4db7a4ffe3c8 service nova] Creating event network-vif-plugged:986e2677-0e75-42ab-a7e2-6b6a21c582d0 for instance e083a930-0680-4dbf-833e-d1bde6998d1f on hv-cinder-82002 Jan 19 16:09:32.553176 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-dd766ade-0216-46b6-a42d-2c86e0a0ad74 req-aeee52c6-5022-4091-b32d-4db7a4ffe3c8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031445 Jan 19 16:09:32.553826 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 483/1031] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:09:33.482143 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-31626f3a-dea4-4bf6-8e01-7530592155b0 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:33.482771 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-31626f3a-dea4-4bf6-8e01-7530592155b0 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:33.489838 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-31626f3a-dea4-4bf6-8e01-7530592155b0 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:33.490285 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-31626f3a-dea4-4bf6-8e01-7530592155b0 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:33.491130 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-31626f3a-dea4-4bf6-8e01-7530592155b0 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:33.491567 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-31626f3a-dea4-4bf6-8e01-7530592155b0 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:33.642162 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-31626f3a-dea4-4bf6-8e01-7530592155b0 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:33.650413 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-31626f3a-dea4-4bf6-8e01-7530592155b0 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1266 microversion: 2.1 time: 0.172197 Jan 19 16:09:33.651029 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 549/1032] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:33 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:34.676096 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-51e58cf0-3b9e-4c0c-ad6b-b6bf70a4a58b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:34.676777 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-51e58cf0-3b9e-4c0c-ad6b-b6bf70a4a58b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:34.684419 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-51e58cf0-3b9e-4c0c-ad6b-b6bf70a4a58b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:34.684860 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-51e58cf0-3b9e-4c0c-ad6b-b6bf70a4a58b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:34.685656 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-51e58cf0-3b9e-4c0c-ad6b-b6bf70a4a58b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:34.686085 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-51e58cf0-3b9e-4c0c-ad6b-b6bf70a4a58b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:34.840979 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-51e58cf0-3b9e-4c0c-ad6b-b6bf70a4a58b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:34.851921 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-51e58cf0-3b9e-4c0c-ad6b-b6bf70a4a58b tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1454 microversion: 2.1 time: 0.180532 Jan 19 16:09:34.852540 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 484/1033] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:34 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1454 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:34.868672 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-87e9048e-774b-4b4c-af51-143210a78f03 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:34.869403 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-87e9048e-774b-4b4c-af51-143210a78f03 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:34.876589 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-87e9048e-774b-4b4c-af51-143210a78f03 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:34.877311 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-87e9048e-774b-4b4c-af51-143210a78f03 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:34.885280 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-87e9048e-774b-4b4c-af51-143210a78f03 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:34.885280 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-87e9048e-774b-4b4c-af51-143210a78f03 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:35.038289 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-87e9048e-774b-4b4c-af51-143210a78f03 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:35.045751 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-87e9048e-774b-4b4c-af51-143210a78f03 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1454 microversion: 2.1 time: 0.180977 Jan 19 16:09:35.046336 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 550/1034] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:09:34 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1454 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:09:37.627650 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-17800751-2d64-43ec-a138-e3eb3a929b69 req-90e54d76-2dd5-4f2c-ba41-6c7468144b87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e083a930-0680-4dbf-833e-d1bde6998d1f", "tag": "986e2677-0e75-42ab-a7e2-6b6a21c582d0"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:09:37.629235 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:09:37.629235 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:09:37.643627 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-17800751-2d64-43ec-a138-e3eb3a929b69 req-90e54d76-2dd5-4f2c-ba41-6c7468144b87 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:37.643978 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-17800751-2d64-43ec-a138-e3eb3a929b69 req-90e54d76-2dd5-4f2c-ba41-6c7468144b87 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:37.660704 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-17800751-2d64-43ec-a138-e3eb3a929b69 req-90e54d76-2dd5-4f2c-ba41-6c7468144b87 service nova] Creating event network-changed:986e2677-0e75-42ab-a7e2-6b6a21c582d0 for instance e083a930-0680-4dbf-833e-d1bde6998d1f on hv-cinder-82002 Jan 19 16:09:37.666314 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-17800751-2d64-43ec-a138-e3eb3a929b69 req-90e54d76-2dd5-4f2c-ba41-6c7468144b87 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042166 Jan 19 16:09:37.666928 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 485/1035] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:09:38.245289 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e21fbbd6-4360-4928-b5ee-32d0273658de tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:38.246879 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-e21fbbd6-4360-4928-b5ee-32d0273658de tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:38.261906 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e21fbbd6-4360-4928-b5ee-32d0273658de tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:38.262597 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e21fbbd6-4360-4928-b5ee-32d0273658de tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:38.264012 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e21fbbd6-4360-4928-b5ee-32d0273658de tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:38.264826 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-e21fbbd6-4360-4928-b5ee-32d0273658de tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:38.310776 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e21fbbd6-4360-4928-b5ee-32d0273658de tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/os-volume_attachments/3bf21bcd-d09b-4511-9fec-9949f0e3d10a" status: 200 len: 194 microversion: 2.20 time: 0.071694 Jan 19 16:09:38.311973 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 551/1036] 10.222.0.58 () {60 vars in 1453 bytes} [Wed Jan 19 16:09:38 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/os-volume_attachments/3bf21bcd-d09b-4511-9fec-9949f0e3d10a => generated 194 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:09:38.398633 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e1f124bd-1b4d-438d-8070-b837b42b2365 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:38.399279 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-e1f124bd-1b4d-438d-8070-b837b42b2365 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:38.406050 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e1f124bd-1b4d-438d-8070-b837b42b2365 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:38.406932 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e1f124bd-1b4d-438d-8070-b837b42b2365 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:38.408314 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e1f124bd-1b4d-438d-8070-b837b42b2365 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:38.408941 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e1f124bd-1b4d-438d-8070-b837b42b2365 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:38.500032 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.objects.instance [None req-e1f124bd-1b4d-438d-8070-b837b42b2365 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lazy-loading 'services' on Instance uuid 02ba601a-94e7-486f-9d1b-7418ae534f4f {{(pid=128875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:09:38.771091 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e1f124bd-1b4d-438d-8070-b837b42b2365 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "DELETE /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/os-volume_attachments/3bf21bcd-d09b-4511-9fec-9949f0e3d10a" status: 202 len: 0 microversion: 2.20 time: 0.375887 Jan 19 16:09:38.775625 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 486/1037] 10.222.0.58 () {60 vars in 1456 bytes} [Wed Jan 19 16:09:38 2022] DELETE /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/os-volume_attachments/3bf21bcd-d09b-4511-9fec-9949f0e3d10a => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:09:38.782221 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-7780e3ae-3937-4aa2-8893-b842eda7f507 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:38.783516 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-7780e3ae-3937-4aa2-8893-b842eda7f507 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:38.797952 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7780e3ae-3937-4aa2-8893-b842eda7f507 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:38.802370 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7780e3ae-3937-4aa2-8893-b842eda7f507 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:38.802370 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7780e3ae-3937-4aa2-8893-b842eda7f507 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:38.802370 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7780e3ae-3937-4aa2-8893-b842eda7f507 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:38.834479 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-7780e3ae-3937-4aa2-8893-b842eda7f507 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056796 Jan 19 16:09:38.835083 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 552/1038] 10.222.0.58 () {60 vars in 1342 bytes} [Wed Jan 19 16:09:38 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:09:39.848019 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-5e23c2aa-1d4d-4ab5-9ac7-08858b65f9ff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:39.848934 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-5e23c2aa-1d4d-4ab5-9ac7-08858b65f9ff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:39.856288 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5e23c2aa-1d4d-4ab5-9ac7-08858b65f9ff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:39.856729 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5e23c2aa-1d4d-4ab5-9ac7-08858b65f9ff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:39.857517 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5e23c2aa-1d4d-4ab5-9ac7-08858b65f9ff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:39.857938 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5e23c2aa-1d4d-4ab5-9ac7-08858b65f9ff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:39.892544 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-5e23c2aa-1d4d-4ab5-9ac7-08858b65f9ff tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046944 Jan 19 16:09:39.892544 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 487/1039] 10.222.0.58 () {60 vars in 1342 bytes} [Wed Jan 19 16:09:39 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:09:40.904043 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5bad3fa1-8f77-4b04-92f2-751b06336671 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:40.905465 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5bad3fa1-8f77-4b04-92f2-751b06336671 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:40.915027 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5bad3fa1-8f77-4b04-92f2-751b06336671 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:40.920994 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5bad3fa1-8f77-4b04-92f2-751b06336671 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:40.920994 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5bad3fa1-8f77-4b04-92f2-751b06336671 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:40.920994 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5bad3fa1-8f77-4b04-92f2-751b06336671 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:40.952112 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5bad3fa1-8f77-4b04-92f2-751b06336671 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053237 Jan 19 16:09:40.952717 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 553/1040] 10.222.0.58 () {60 vars in 1342 bytes} [Wed Jan 19 16:09:40 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:09:41.016484 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ac21d6de-0cc2-4291-9e3b-8b940d0e3179 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:41.017565 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-ac21d6de-0cc2-4291-9e3b-8b940d0e3179 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:41.027766 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ac21d6de-0cc2-4291-9e3b-8b940d0e3179 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:41.028389 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ac21d6de-0cc2-4291-9e3b-8b940d0e3179 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:41.029380 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ac21d6de-0cc2-4291-9e3b-8b940d0e3179 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:41.029856 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ac21d6de-0cc2-4291-9e3b-8b940d0e3179 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:41.056947 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-ac21d6de-0cc2-4291-9e3b-8b940d0e3179 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Going to try to terminate instance {{(pid=128875) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:09:41.358455 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-ac21d6de-0cc2-4291-9e3b-8b940d0e3179 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "DELETE /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 204 len: 0 microversion: 2.20 time: 0.345636 Jan 19 16:09:41.359084 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 488/1041] 10.222.0.58 () {60 vars in 1279 bytes} [Wed Jan 19 16:09:41 2022] DELETE /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 19 16:09:41.368278 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-dc095a7c-6a79-49d2-8d57-6033d178a405 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:41.368955 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-dc095a7c-6a79-49d2-8d57-6033d178a405 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:41.375547 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dc095a7c-6a79-49d2-8d57-6033d178a405 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:41.376000 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dc095a7c-6a79-49d2-8d57-6033d178a405 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:41.376960 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dc095a7c-6a79-49d2-8d57-6033d178a405 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:41.377554 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dc095a7c-6a79-49d2-8d57-6033d178a405 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:41.541397 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-dc095a7c-6a79-49d2-8d57-6033d178a405 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:41.556527 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-dc095a7c-6a79-49d2-8d57-6033d178a405 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:41.559220 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-dc095a7c-6a79-49d2-8d57-6033d178a405 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:41.561225 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-dc095a7c-6a79-49d2-8d57-6033d178a405 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1720 microversion: 2.20 time: 0.197304 Jan 19 16:09:41.562129 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 554/1042] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:09:41 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1720 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:09:42.589055 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-638b46ce-339c-4c25-b87a-47cf9af277bf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:42.589834 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-638b46ce-339c-4c25-b87a-47cf9af277bf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:42.596835 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-638b46ce-339c-4c25-b87a-47cf9af277bf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:42.597273 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-638b46ce-339c-4c25-b87a-47cf9af277bf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:42.598070 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-638b46ce-339c-4c25-b87a-47cf9af277bf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:42.598686 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-638b46ce-339c-4c25-b87a-47cf9af277bf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:42.751048 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-638b46ce-339c-4c25-b87a-47cf9af277bf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:42.760302 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-638b46ce-339c-4c25-b87a-47cf9af277bf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:42.761816 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-638b46ce-339c-4c25-b87a-47cf9af277bf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:42.763145 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-638b46ce-339c-4c25-b87a-47cf9af277bf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1720 microversion: 2.20 time: 0.179439 Jan 19 16:09:42.763708 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 489/1043] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:09:42 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1720 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:09:43.782169 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-45b15fee-ebc7-4a6c-91f0-2c711821894a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:43.782818 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-45b15fee-ebc7-4a6c-91f0-2c711821894a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:43.790368 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-45b15fee-ebc7-4a6c-91f0-2c711821894a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:43.790810 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-45b15fee-ebc7-4a6c-91f0-2c711821894a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:43.791632 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-45b15fee-ebc7-4a6c-91f0-2c711821894a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:43.792067 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-45b15fee-ebc7-4a6c-91f0-2c711821894a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:43.970474 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-45b15fee-ebc7-4a6c-91f0-2c711821894a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:43.983940 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-45b15fee-ebc7-4a6c-91f0-2c711821894a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:43.985518 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-45b15fee-ebc7-4a6c-91f0-2c711821894a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:43.986790 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-45b15fee-ebc7-4a6c-91f0-2c711821894a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1720 microversion: 2.20 time: 0.208500 Jan 19 16:09:43.987398 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 555/1044] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:09:43 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1720 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:09:44.626698 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-c924f456-97ed-45be-9784-339d9acd223c req-f4d3b0e0-8980-44fc-9bea-996f64b307e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02ba601a-94e7-486f-9d1b-7418ae534f4f", "name": "network-vif-deleted", "tag": "51ed4245-58bf-4cc7-838e-9cad3734639e"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:09:44.629008 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:09:44.629008 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:09:44.638087 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-c924f456-97ed-45be-9784-339d9acd223c req-f4d3b0e0-8980-44fc-9bea-996f64b307e2 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:44.638532 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-c924f456-97ed-45be-9784-339d9acd223c req-f4d3b0e0-8980-44fc-9bea-996f64b307e2 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:44.660435 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-c924f456-97ed-45be-9784-339d9acd223c req-f4d3b0e0-8980-44fc-9bea-996f64b307e2 service nova] Creating event network-vif-deleted:51ed4245-58bf-4cc7-838e-9cad3734639e for instance 02ba601a-94e7-486f-9d1b-7418ae534f4f on hv-cinder-82002 Jan 19 16:09:44.665464 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-c924f456-97ed-45be-9784-339d9acd223c req-f4d3b0e0-8980-44fc-9bea-996f64b307e2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041842 Jan 19 16:09:44.666867 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 490/1045] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:09:45.008633 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b901652e-f6da-4df1-ae90-eade644982ea tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:45.009988 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b901652e-f6da-4df1-ae90-eade644982ea tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:45.019706 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b901652e-f6da-4df1-ae90-eade644982ea tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:45.020411 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b901652e-f6da-4df1-ae90-eade644982ea tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:45.025965 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b901652e-f6da-4df1-ae90-eade644982ea tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:45.025965 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b901652e-f6da-4df1-ae90-eade644982ea tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:45.077119 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b901652e-f6da-4df1-ae90-eade644982ea tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:45.078010 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b901652e-f6da-4df1-ae90-eade644982ea tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:45.078621 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.objects.instance [None req-b901652e-f6da-4df1-ae90-eade644982ea tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lazy-loading 'fault' on Instance uuid 02ba601a-94e7-486f-9d1b-7418ae534f4f {{(pid=128876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:09:45.123801 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-b901652e-f6da-4df1-ae90-eade644982ea tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:45.132308 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-b901652e-f6da-4df1-ae90-eade644982ea tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:45.134411 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-b901652e-f6da-4df1-ae90-eade644982ea tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:45.135990 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b901652e-f6da-4df1-ae90-eade644982ea tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 200 len: 1369 microversion: 2.20 time: 0.131247 Jan 19 16:09:45.136560 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 556/1046] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:09:45 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 1369 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:09:46.161266 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-850db2b8-b091-4c07-8fc3-c5d1ffc2e776 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:46.162103 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-850db2b8-b091-4c07-8fc3-c5d1ffc2e776 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:46.169391 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-850db2b8-b091-4c07-8fc3-c5d1ffc2e776 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:46.169840 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-850db2b8-b091-4c07-8fc3-c5d1ffc2e776 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:46.170627 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-850db2b8-b091-4c07-8fc3-c5d1ffc2e776 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:46.171128 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-850db2b8-b091-4c07-8fc3-c5d1ffc2e776 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:46.185028 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.wsgi [None req-850db2b8-b091-4c07-8fc3-c5d1ffc2e776 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] HTTP exception thrown: Instance 02ba601a-94e7-486f-9d1b-7418ae534f4f could not be found. Jan 19 16:09:46.185618 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-850db2b8-b091-4c07-8fc3-c5d1ffc2e776 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Returning 404 to user: Instance 02ba601a-94e7-486f-9d1b-7418ae534f4f could not be found. {{(pid=128875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:09:46.186468 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-850db2b8-b091-4c07-8fc3-c5d1ffc2e776 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 404 len: 111 microversion: 2.20 time: 0.029803 Jan 19 16:09:46.187049 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 491/1047] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:09:46 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:09:46.195259 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d86276bd-0883-4df4-94f4-717d41beab98 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '.version_select at 0x7feff51404c0>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:46.276766 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-d86276bd-0883-4df4-94f4-717d41beab98 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-805844353" status: 204 len: 0 microversion: 2.20 time: 0.084887 Jan 19 16:09:46.277389 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 557/1048] 10.222.0.58 () {60 vars in 1258 bytes} [Wed Jan 19 16:09:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-805844353 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 19 16:09:47.151529 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f5f6b74e-b1ca-4877-9fb6-d35141a12a41 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'create', calling method: .version_select at 0x7feff51ccf70>, body: {"keypair": {"name": "tempest-keypair-218475517"}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:09:47.164951 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-f5f6b74e-b1ca-4877-9fb6-d35141a12a41 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Getting quotas for project 349fd4b6edd347a09b8d1ded2f25a2dd. Resources: {'key_pairs'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:09:47.168640 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-f5f6b74e-b1ca-4877-9fb6-d35141a12a41 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Getting quotas for user b9abf8deacfc4edbb0a5585ea1fc7861 and project 349fd4b6edd347a09b8d1ded2f25a2dd. Resources: {'key_pairs'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:09:47.318592 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-f5f6b74e-b1ca-4877-9fb6-d35141a12a41 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Getting quotas for project 349fd4b6edd347a09b8d1ded2f25a2dd. Resources: {'key_pairs'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:09:47.322558 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-f5f6b74e-b1ca-4877-9fb6-d35141a12a41 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Getting quotas for user b9abf8deacfc4edbb0a5585ea1fc7861 and project 349fd4b6edd347a09b8d1ded2f25a2dd. Resources: {'key_pairs'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:09:47.339035 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f5f6b74e-b1ca-4877-9fb6-d35141a12a41 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.191345 Jan 19 16:09:47.339990 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 492/1049] 10.222.0.58 () {62 vars in 1198 bytes} [Wed Jan 19 16:09:47 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 193 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 19 16:09:49.937466 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3696a871-f448-4902-8f0d-64f47aa32a30 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1089155348", "imageRef": "6d9c05bd-015a-44de-bd51-f744cb247e7a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "abe499d5-f64b-4529-88b6-f40c0516e98e"}], "security_groups": [{"name": "tempest-securitygroup--1908685736"}], "key_name": "tempest-keypair-218475517", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:09:50.044862 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.network.neutron [None req-3696a871-f448-4902-8f0d-64f47aa32a30 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] validate_networks() for [('abe499d5-f64b-4529-88b6-f40c0516e98e', None, None, None, None, None)] {{(pid=128876) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:09:50.436000 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-3696a871-f448-4902-8f0d-64f47aa32a30 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Flavor limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:09:50.436421 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-3696a871-f448-4902-8f0d-64f47aa32a30 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Image limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:09:50.436888 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-3696a871-f448-4902-8f0d-64f47aa32a30 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Flavor pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:09:50.437289 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-3696a871-f448-4902-8f0d-64f47aa32a30 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Image pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:09:50.437693 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-3696a871-f448-4902-8f0d-64f47aa32a30 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:09:50.446565 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3696a871-f448-4902-8f0d-64f47aa32a30 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:50.447043 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3696a871-f448-4902-8f0d-64f47aa32a30 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:50.447857 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3696a871-f448-4902-8f0d-64f47aa32a30 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:50.448292 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3696a871-f448-4902-8f0d-64f47aa32a30 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:50.465667 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-3696a871-f448-4902-8f0d-64f47aa32a30 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Getting quotas for project 349fd4b6edd347a09b8d1ded2f25a2dd. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:09:50.469517 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-3696a871-f448-4902-8f0d-64f47aa32a30 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Getting quotas for user b9abf8deacfc4edbb0a5585ea1fc7861 and project 349fd4b6edd347a09b8d1ded2f25a2dd. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:09:50.480433 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3696a871-f448-4902-8f0d-64f47aa32a30 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Going to run 1 instances... {{(pid=128876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:09:50.482678 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3696a871-f448-4902-8f0d-64f47aa32a30 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6d9c05bd-015a-44de-bd51-f744cb247e7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:09:50.606936 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3696a871-f448-4902-8f0d-64f47aa32a30 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.673661 Jan 19 16:09:50.607685 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 558/1050] 10.222.0.58 () {62 vars in 1187 bytes} [Wed Jan 19 16:09:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 19 16:09:50.618383 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ec7de574-c8e1-4f89-a202-b2db2310f8b0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:50.619461 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-ec7de574-c8e1-4f89-a202-b2db2310f8b0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:50.677389 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ec7de574-c8e1-4f89-a202-b2db2310f8b0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:50.687276 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ec7de574-c8e1-4f89-a202-b2db2310f8b0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:50.688895 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ec7de574-c8e1-4f89-a202-b2db2310f8b0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:50.690019 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-ec7de574-c8e1-4f89-a202-b2db2310f8b0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1281 microversion: 2.20 time: 0.076080 Jan 19 16:09:50.690589 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 493/1051] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:09:50 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:09:51.708805 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a550a564-179d-428e-b57c-057070926432 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:51.709599 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a550a564-179d-428e-b57c-057070926432 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:51.717293 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a550a564-179d-428e-b57c-057070926432 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:51.717829 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a550a564-179d-428e-b57c-057070926432 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:51.718546 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a550a564-179d-428e-b57c-057070926432 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:51.718991 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a550a564-179d-428e-b57c-057070926432 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:51.780037 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a550a564-179d-428e-b57c-057070926432 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:51.788050 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a550a564-179d-428e-b57c-057070926432 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:51.790342 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a550a564-179d-428e-b57c-057070926432 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:51.791746 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a550a564-179d-428e-b57c-057070926432 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1285 microversion: 2.20 time: 0.086941 Jan 19 16:09:51.796145 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 559/1052] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:09:51 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:09:52.812066 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-1cc47868-6962-4639-a26d-20f2d0eafb6f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:52.812800 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-1cc47868-6962-4639-a26d-20f2d0eafb6f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:52.820195 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1cc47868-6962-4639-a26d-20f2d0eafb6f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:52.824902 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1cc47868-6962-4639-a26d-20f2d0eafb6f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:52.824902 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1cc47868-6962-4639-a26d-20f2d0eafb6f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:52.824902 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1cc47868-6962-4639-a26d-20f2d0eafb6f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:52.897013 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-1cc47868-6962-4639-a26d-20f2d0eafb6f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:52.905589 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-1cc47868-6962-4639-a26d-20f2d0eafb6f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:52.907209 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-1cc47868-6962-4639-a26d-20f2d0eafb6f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:52.908318 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-1cc47868-6962-4639-a26d-20f2d0eafb6f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1351 microversion: 2.20 time: 0.100851 Jan 19 16:09:52.909133 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 494/1053] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:09:52 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:09:53.926739 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f6c0c96b-8c1e-4dfd-9b7d-66069616a44e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:53.927558 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f6c0c96b-8c1e-4dfd-9b7d-66069616a44e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:53.935740 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f6c0c96b-8c1e-4dfd-9b7d-66069616a44e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:53.936191 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f6c0c96b-8c1e-4dfd-9b7d-66069616a44e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:53.936997 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f6c0c96b-8c1e-4dfd-9b7d-66069616a44e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:53.937433 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f6c0c96b-8c1e-4dfd-9b7d-66069616a44e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:54.087041 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f6c0c96b-8c1e-4dfd-9b7d-66069616a44e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:54.097349 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f6c0c96b-8c1e-4dfd-9b7d-66069616a44e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:54.098878 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f6c0c96b-8c1e-4dfd-9b7d-66069616a44e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:54.100058 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f6c0c96b-8c1e-4dfd-9b7d-66069616a44e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1407 microversion: 2.20 time: 0.177151 Jan 19 16:09:54.100630 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 560/1054] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:09:53 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:09:54.314036 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-276f938e-4a74-4c80-a64d-04a1cfb801ac req-108ee0ab-6ff3-4c4a-b8a5-f227ba7a2280 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c1319b6-bda0-474e-bf40-08f9106fa169", "tag": "a7371518-3a83-43f3-a73a-17f850f9c369"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:09:54.315955 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:09:54.315955 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:09:54.323827 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-276f938e-4a74-4c80-a64d-04a1cfb801ac req-108ee0ab-6ff3-4c4a-b8a5-f227ba7a2280 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:54.324264 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-276f938e-4a74-4c80-a64d-04a1cfb801ac req-108ee0ab-6ff3-4c4a-b8a5-f227ba7a2280 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:54.336321 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-276f938e-4a74-4c80-a64d-04a1cfb801ac req-108ee0ab-6ff3-4c4a-b8a5-f227ba7a2280 service nova] Creating event network-changed:a7371518-3a83-43f3-a73a-17f850f9c369 for instance 9c1319b6-bda0-474e-bf40-08f9106fa169 on hv-cinder-82002 Jan 19 16:09:54.342078 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-276f938e-4a74-4c80-a64d-04a1cfb801ac req-108ee0ab-6ff3-4c4a-b8a5-f227ba7a2280 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032365 Jan 19 16:09:54.342679 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 495/1055] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:09:55.118700 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-288e9d3a-1ef3-4df8-8430-dc03a06ba56c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:55.119333 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-288e9d3a-1ef3-4df8-8430-dc03a06ba56c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:55.125735 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-288e9d3a-1ef3-4df8-8430-dc03a06ba56c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:55.126186 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-288e9d3a-1ef3-4df8-8430-dc03a06ba56c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:55.127005 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-288e9d3a-1ef3-4df8-8430-dc03a06ba56c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:55.127446 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-288e9d3a-1ef3-4df8-8430-dc03a06ba56c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:55.274618 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-288e9d3a-1ef3-4df8-8430-dc03a06ba56c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:55.282680 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-288e9d3a-1ef3-4df8-8430-dc03a06ba56c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:55.284211 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-288e9d3a-1ef3-4df8-8430-dc03a06ba56c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:55.285309 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-288e9d3a-1ef3-4df8-8430-dc03a06ba56c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1407 microversion: 2.20 time: 0.170440 Jan 19 16:09:55.285972 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 561/1056] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:09:55 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:09:56.306489 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c36fd892-ec84-4a7d-af61-30b0a8958fce tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:56.307201 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c36fd892-ec84-4a7d-af61-30b0a8958fce tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:56.313260 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c36fd892-ec84-4a7d-af61-30b0a8958fce tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:56.313695 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c36fd892-ec84-4a7d-af61-30b0a8958fce tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:56.314461 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c36fd892-ec84-4a7d-af61-30b0a8958fce tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:56.314889 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c36fd892-ec84-4a7d-af61-30b0a8958fce tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:56.452151 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c36fd892-ec84-4a7d-af61-30b0a8958fce tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:56.460124 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c36fd892-ec84-4a7d-af61-30b0a8958fce tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:56.461625 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c36fd892-ec84-4a7d-af61-30b0a8958fce tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:56.462717 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c36fd892-ec84-4a7d-af61-30b0a8958fce tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1407 microversion: 2.20 time: 0.161753 Jan 19 16:09:56.463317 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 496/1057] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:09:56 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:09:57.480816 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8c4bede1-e3a1-4368-8f2a-14e9a640fff5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:57.481411 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-8c4bede1-e3a1-4368-8f2a-14e9a640fff5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:57.487520 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8c4bede1-e3a1-4368-8f2a-14e9a640fff5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:57.487967 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8c4bede1-e3a1-4368-8f2a-14e9a640fff5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:57.488734 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8c4bede1-e3a1-4368-8f2a-14e9a640fff5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:57.489159 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8c4bede1-e3a1-4368-8f2a-14e9a640fff5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:57.626616 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8c4bede1-e3a1-4368-8f2a-14e9a640fff5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:57.634517 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8c4bede1-e3a1-4368-8f2a-14e9a640fff5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:57.636761 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8c4bede1-e3a1-4368-8f2a-14e9a640fff5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:57.637906 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-8c4bede1-e3a1-4368-8f2a-14e9a640fff5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1407 microversion: 2.20 time: 0.160834 Jan 19 16:09:57.638490 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 562/1058] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:09:57 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:09:58.657271 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-088de789-4964-4612-b69d-012e45e216e9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:58.657915 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-088de789-4964-4612-b69d-012e45e216e9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:58.664216 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-088de789-4964-4612-b69d-012e45e216e9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:58.664661 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-088de789-4964-4612-b69d-012e45e216e9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:58.665439 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-088de789-4964-4612-b69d-012e45e216e9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:58.665873 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-088de789-4964-4612-b69d-012e45e216e9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:58.805673 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-088de789-4964-4612-b69d-012e45e216e9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:58.814005 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-088de789-4964-4612-b69d-012e45e216e9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:58.817981 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-088de789-4964-4612-b69d-012e45e216e9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:58.817981 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-088de789-4964-4612-b69d-012e45e216e9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1407 microversion: 2.20 time: 0.163112 Jan 19 16:09:58.817981 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 497/1059] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:09:58 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:09:59.834835 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5243b1f6-0836-4372-b178-790c0dd96335 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:09:59.835437 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5243b1f6-0836-4372-b178-790c0dd96335 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:09:59.842315 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5243b1f6-0836-4372-b178-790c0dd96335 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:59.842751 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5243b1f6-0836-4372-b178-790c0dd96335 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:59.843568 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5243b1f6-0836-4372-b178-790c0dd96335 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:09:59.843988 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5243b1f6-0836-4372-b178-790c0dd96335 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:09:59.973420 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5243b1f6-0836-4372-b178-790c0dd96335 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:59.981511 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5243b1f6-0836-4372-b178-790c0dd96335 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:59.983053 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5243b1f6-0836-4372-b178-790c0dd96335 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:09:59.984169 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5243b1f6-0836-4372-b178-790c0dd96335 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1407 microversion: 2.20 time: 0.153113 Jan 19 16:09:59.984729 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 563/1060] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:09:59 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:10:01.002421 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6c70b341-3644-44c4-93e1-a1b0982ffc9d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:01.002961 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-6c70b341-3644-44c4-93e1-a1b0982ffc9d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:01.009307 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6c70b341-3644-44c4-93e1-a1b0982ffc9d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:01.009745 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6c70b341-3644-44c4-93e1-a1b0982ffc9d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:01.010523 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6c70b341-3644-44c4-93e1-a1b0982ffc9d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:01.010955 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6c70b341-3644-44c4-93e1-a1b0982ffc9d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:01.151338 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6c70b341-3644-44c4-93e1-a1b0982ffc9d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:01.160371 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6c70b341-3644-44c4-93e1-a1b0982ffc9d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:01.162505 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6c70b341-3644-44c4-93e1-a1b0982ffc9d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:01.163147 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6c70b341-3644-44c4-93e1-a1b0982ffc9d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1407 microversion: 2.20 time: 0.164613 Jan 19 16:10:01.163877 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 498/1061] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:10:00 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:10:02.181451 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-13922883-b95f-426c-af0a-8f1ec5ed410b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:02.182035 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-13922883-b95f-426c-af0a-8f1ec5ed410b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:02.188485 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-13922883-b95f-426c-af0a-8f1ec5ed410b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:02.188923 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-13922883-b95f-426c-af0a-8f1ec5ed410b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:02.189704 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-13922883-b95f-426c-af0a-8f1ec5ed410b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:02.190154 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-13922883-b95f-426c-af0a-8f1ec5ed410b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:02.324128 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-13922883-b95f-426c-af0a-8f1ec5ed410b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:02.332476 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-13922883-b95f-426c-af0a-8f1ec5ed410b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:02.333968 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-13922883-b95f-426c-af0a-8f1ec5ed410b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:02.335143 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-13922883-b95f-426c-af0a-8f1ec5ed410b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1407 microversion: 2.20 time: 0.157724 Jan 19 16:10:02.335704 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 564/1062] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:10:02 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:10:02.644552 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-ce7b69e5-cd04-4377-9ad6-292f9bbd6fa3 req-6955cddf-983e-48a2-956a-17e97de2110c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c1319b6-bda0-474e-bf40-08f9106fa169", "name": "network-vif-plugged", "status": "completed", "tag": "a7371518-3a83-43f3-a73a-17f850f9c369"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:02.646113 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:10:02.646113 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:10:02.653845 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-ce7b69e5-cd04-4377-9ad6-292f9bbd6fa3 req-6955cddf-983e-48a2-956a-17e97de2110c service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:02.654278 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-ce7b69e5-cd04-4377-9ad6-292f9bbd6fa3 req-6955cddf-983e-48a2-956a-17e97de2110c service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:02.664790 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-ce7b69e5-cd04-4377-9ad6-292f9bbd6fa3 req-6955cddf-983e-48a2-956a-17e97de2110c service nova] Creating event network-vif-plugged:a7371518-3a83-43f3-a73a-17f850f9c369 for instance 9c1319b6-bda0-474e-bf40-08f9106fa169 on hv-cinder-82002 Jan 19 16:10:02.670506 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-ce7b69e5-cd04-4377-9ad6-292f9bbd6fa3 req-6955cddf-983e-48a2-956a-17e97de2110c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029570 Jan 19 16:10:02.671106 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 499/1063] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:10:03.353644 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-6725eda6-2e91-4b6b-99b3-e443240798ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:03.354225 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-6725eda6-2e91-4b6b-99b3-e443240798ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:03.360564 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6725eda6-2e91-4b6b-99b3-e443240798ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:03.361007 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6725eda6-2e91-4b6b-99b3-e443240798ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:03.361810 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6725eda6-2e91-4b6b-99b3-e443240798ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:03.362242 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6725eda6-2e91-4b6b-99b3-e443240798ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:03.499327 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-6725eda6-2e91-4b6b-99b3-e443240798ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:03.507533 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-6725eda6-2e91-4b6b-99b3-e443240798ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:03.509045 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-6725eda6-2e91-4b6b-99b3-e443240798ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:03.510185 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-6725eda6-2e91-4b6b-99b3-e443240798ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1407 microversion: 2.20 time: 0.160280 Jan 19 16:10:03.510747 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 565/1064] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:10:03 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:10:04.530034 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-32e07e3a-d81d-4f4f-9f75-892726cd50a7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:04.530723 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-32e07e3a-d81d-4f4f-9f75-892726cd50a7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:04.536912 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-32e07e3a-d81d-4f4f-9f75-892726cd50a7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:04.537358 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-32e07e3a-d81d-4f4f-9f75-892726cd50a7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:04.538142 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-32e07e3a-d81d-4f4f-9f75-892726cd50a7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:04.538579 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-32e07e3a-d81d-4f4f-9f75-892726cd50a7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:04.676059 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-32e07e3a-d81d-4f4f-9f75-892726cd50a7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:04.684309 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-32e07e3a-d81d-4f4f-9f75-892726cd50a7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:04.685808 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-32e07e3a-d81d-4f4f-9f75-892726cd50a7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:04.686905 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-32e07e3a-d81d-4f4f-9f75-892726cd50a7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1407 microversion: 2.20 time: 0.162264 Jan 19 16:10:04.687491 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 500/1065] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:10:04 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:10:05.704849 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-95761786-95e0-47ea-a09d-108fd970f36f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:05.705442 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-95761786-95e0-47ea-a09d-108fd970f36f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:05.711738 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-95761786-95e0-47ea-a09d-108fd970f36f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:05.712181 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-95761786-95e0-47ea-a09d-108fd970f36f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:05.712955 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-95761786-95e0-47ea-a09d-108fd970f36f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:05.713384 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-95761786-95e0-47ea-a09d-108fd970f36f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:05.838581 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-95761786-95e0-47ea-a09d-108fd970f36f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:05.847009 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-95761786-95e0-47ea-a09d-108fd970f36f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:05.848526 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-95761786-95e0-47ea-a09d-108fd970f36f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:05.849679 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-95761786-95e0-47ea-a09d-108fd970f36f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1599 microversion: 2.20 time: 0.148645 Jan 19 16:10:05.850248 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 566/1066] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:10:05 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:10:05.867996 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f52bd600-66aa-4cf6-ab25-faf8dcfad936 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:05.868506 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-f52bd600-66aa-4cf6-ab25-faf8dcfad936 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:05.874780 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f52bd600-66aa-4cf6-ab25-faf8dcfad936 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:05.875261 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f52bd600-66aa-4cf6-ab25-faf8dcfad936 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:05.876036 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f52bd600-66aa-4cf6-ab25-faf8dcfad936 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:05.876470 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f52bd600-66aa-4cf6-ab25-faf8dcfad936 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:05.956341 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f52bd600-66aa-4cf6-ab25-faf8dcfad936 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092176 Jan 19 16:10:05.956930 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 501/1067] 10.222.0.58 () {60 vars in 1315 bytes} [Wed Jan 19 16:10:05 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:10:07.244005 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-14f0a4bf-8154-4cbd-9a5e-1f2a9f21858a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:07.245121 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-14f0a4bf-8154-4cbd-9a5e-1f2a9f21858a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:07.252918 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-e74abc54-3215-48cf-92ac-1036e5108144 req-88c537a2-24e8-4cc9-b14b-fb086aeed097 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c1319b6-bda0-474e-bf40-08f9106fa169", "tag": "a7371518-3a83-43f3-a73a-17f850f9c369"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:07.253358 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-14f0a4bf-8154-4cbd-9a5e-1f2a9f21858a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:07.253525 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-14f0a4bf-8154-4cbd-9a5e-1f2a9f21858a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:07.254458 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-14f0a4bf-8154-4cbd-9a5e-1f2a9f21858a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:07.254565 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:10:07.254565 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:10:07.255000 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-14f0a4bf-8154-4cbd-9a5e-1f2a9f21858a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:07.267277 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-e74abc54-3215-48cf-92ac-1036e5108144 req-88c537a2-24e8-4cc9-b14b-fb086aeed097 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:07.267645 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-e74abc54-3215-48cf-92ac-1036e5108144 req-88c537a2-24e8-4cc9-b14b-fb086aeed097 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:07.279156 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-e74abc54-3215-48cf-92ac-1036e5108144 req-88c537a2-24e8-4cc9-b14b-fb086aeed097 service nova] Creating event network-changed:a7371518-3a83-43f3-a73a-17f850f9c369 for instance 9c1319b6-bda0-474e-bf40-08f9106fa169 on hv-cinder-82002 Jan 19 16:10:07.284093 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-e74abc54-3215-48cf-92ac-1036e5108144 req-88c537a2-24e8-4cc9-b14b-fb086aeed097 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041543 Jan 19 16:10:07.284687 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 502/1068] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:10:08.929140 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-14f0a4bf-8154-4cbd-9a5e-1f2a9f21858a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 14 microversion: 2.20 time: 1.688775 Jan 19 16:10:08.930131 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 567/1069] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:07 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 14 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:10:09.941768 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c2c6b0a6-c00e-4e6a-b802-55b58f7cc686 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:09.942671 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c2c6b0a6-c00e-4e6a-b802-55b58f7cc686 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:09.949005 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c2c6b0a6-c00e-4e6a-b802-55b58f7cc686 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:09.950026 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c2c6b0a6-c00e-4e6a-b802-55b58f7cc686 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:09.950811 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c2c6b0a6-c00e-4e6a-b802-55b58f7cc686 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:09.951283 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c2c6b0a6-c00e-4e6a-b802-55b58f7cc686 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:10.008911 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c2c6b0a6-c00e-4e6a-b802-55b58f7cc686 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 14 microversion: 2.20 time: 0.071666 Jan 19 16:10:10.009572 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 503/1070] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:09 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:10:11.020795 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-209d2d53-2555-4bff-9214-173648dddab6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:11.021738 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-209d2d53-2555-4bff-9214-173648dddab6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:11.028866 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-209d2d53-2555-4bff-9214-173648dddab6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:11.029313 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-209d2d53-2555-4bff-9214-173648dddab6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:11.030113 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-209d2d53-2555-4bff-9214-173648dddab6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:11.030547 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-209d2d53-2555-4bff-9214-173648dddab6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:11.091727 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-209d2d53-2555-4bff-9214-173648dddab6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 14 microversion: 2.20 time: 0.075128 Jan 19 16:10:11.092364 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 568/1071] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:11 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:10:12.104130 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6450a6ac-8b99-4518-9b95-54eb1ef5b772 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:12.105319 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-6450a6ac-8b99-4518-9b95-54eb1ef5b772 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:12.112804 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6450a6ac-8b99-4518-9b95-54eb1ef5b772 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:12.113242 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6450a6ac-8b99-4518-9b95-54eb1ef5b772 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:12.114040 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6450a6ac-8b99-4518-9b95-54eb1ef5b772 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:12.114468 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6450a6ac-8b99-4518-9b95-54eb1ef5b772 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:12.175207 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6450a6ac-8b99-4518-9b95-54eb1ef5b772 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 14 microversion: 2.20 time: 0.075537 Jan 19 16:10:12.175994 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 504/1072] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:12 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:10:13.186596 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-9a08939d-033f-4476-bd0f-98701c6de8a3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:13.187623 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-9a08939d-033f-4476-bd0f-98701c6de8a3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:13.194461 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9a08939d-033f-4476-bd0f-98701c6de8a3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:13.194954 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9a08939d-033f-4476-bd0f-98701c6de8a3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:13.195746 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9a08939d-033f-4476-bd0f-98701c6de8a3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:13.196180 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9a08939d-033f-4476-bd0f-98701c6de8a3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:13.254283 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-9a08939d-033f-4476-bd0f-98701c6de8a3 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 14 microversion: 2.20 time: 0.071600 Jan 19 16:10:13.257387 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 569/1073] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:13 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:10:14.265746 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-b8cd5882-b2db-4217-ac59-dc12f4a8a475 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:14.266733 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-b8cd5882-b2db-4217-ac59-dc12f4a8a475 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:14.273619 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b8cd5882-b2db-4217-ac59-dc12f4a8a475 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:14.274058 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b8cd5882-b2db-4217-ac59-dc12f4a8a475 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:14.274828 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b8cd5882-b2db-4217-ac59-dc12f4a8a475 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:14.275295 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b8cd5882-b2db-4217-ac59-dc12f4a8a475 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:14.332656 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-b8cd5882-b2db-4217-ac59-dc12f4a8a475 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 14 microversion: 2.20 time: 0.070880 Jan 19 16:10:14.334858 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 505/1074] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:14 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:10:15.347182 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-7dac7003-2603-42d0-ab07-aae48f702765 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:15.348153 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-7dac7003-2603-42d0-ab07-aae48f702765 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:15.355216 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7dac7003-2603-42d0-ab07-aae48f702765 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:15.356228 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7dac7003-2603-42d0-ab07-aae48f702765 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:15.357012 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7dac7003-2603-42d0-ab07-aae48f702765 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:15.357439 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7dac7003-2603-42d0-ab07-aae48f702765 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:15.421365 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-7dac7003-2603-42d0-ab07-aae48f702765 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 14 microversion: 2.20 time: 0.081237 Jan 19 16:10:15.422002 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 570/1075] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:15 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:10:16.433264 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-241cb1d7-9156-42cb-8b8e-afeffed98da6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:16.434228 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-241cb1d7-9156-42cb-8b8e-afeffed98da6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:16.441226 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-241cb1d7-9156-42cb-8b8e-afeffed98da6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:16.441671 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-241cb1d7-9156-42cb-8b8e-afeffed98da6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:16.442513 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-241cb1d7-9156-42cb-8b8e-afeffed98da6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:16.442894 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-241cb1d7-9156-42cb-8b8e-afeffed98da6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:16.506065 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-241cb1d7-9156-42cb-8b8e-afeffed98da6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 14 microversion: 2.20 time: 0.077170 Jan 19 16:10:16.509605 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 506/1076] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:16 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:10:17.518817 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-2f3e9e8d-7f66-4f74-be91-af8c509f0bdd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:17.519830 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-2f3e9e8d-7f66-4f74-be91-af8c509f0bdd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:17.526782 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2f3e9e8d-7f66-4f74-be91-af8c509f0bdd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:17.527787 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2f3e9e8d-7f66-4f74-be91-af8c509f0bdd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:17.528576 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2f3e9e8d-7f66-4f74-be91-af8c509f0bdd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:17.528999 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2f3e9e8d-7f66-4f74-be91-af8c509f0bdd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:17.602785 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-2f3e9e8d-7f66-4f74-be91-af8c509f0bdd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 9492 microversion: 2.20 time: 0.087879 Jan 19 16:10:17.603504 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 571/1077] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:17 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 9492 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:10:18.615351 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-727b921b-b950-41e8-a057-b77f7dfb7b23 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:18.616347 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-727b921b-b950-41e8-a057-b77f7dfb7b23 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:18.623712 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-727b921b-b950-41e8-a057-b77f7dfb7b23 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:18.624156 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-727b921b-b950-41e8-a057-b77f7dfb7b23 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:18.624940 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-727b921b-b950-41e8-a057-b77f7dfb7b23 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:18.625369 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-727b921b-b950-41e8-a057-b77f7dfb7b23 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:18.703478 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-727b921b-b950-41e8-a057-b77f7dfb7b23 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 16678 microversion: 2.20 time: 0.092138 Jan 19 16:10:18.704148 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 507/1078] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:18 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 16678 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:19.715985 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-2346dbcf-e8c7-433a-be4c-8a4351f58e67 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:19.716978 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-2346dbcf-e8c7-433a-be4c-8a4351f58e67 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:19.723982 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2346dbcf-e8c7-433a-be4c-8a4351f58e67 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:19.724421 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2346dbcf-e8c7-433a-be4c-8a4351f58e67 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:19.725197 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2346dbcf-e8c7-433a-be4c-8a4351f58e67 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:19.725621 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2346dbcf-e8c7-433a-be4c-8a4351f58e67 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:19.801939 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-2346dbcf-e8c7-433a-be4c-8a4351f58e67 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 18498 microversion: 2.20 time: 0.090463 Jan 19 16:10:19.802586 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 572/1079] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:19 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 18498 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:20.814135 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d9b54cf8-a249-4bc7-8e44-f6a701d52365 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:20.815154 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d9b54cf8-a249-4bc7-8e44-f6a701d52365 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:20.821968 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d9b54cf8-a249-4bc7-8e44-f6a701d52365 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:20.825923 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d9b54cf8-a249-4bc7-8e44-f6a701d52365 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:20.825923 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d9b54cf8-a249-4bc7-8e44-f6a701d52365 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:20.825923 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d9b54cf8-a249-4bc7-8e44-f6a701d52365 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:20.907464 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d9b54cf8-a249-4bc7-8e44-f6a701d52365 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 20757 microversion: 2.20 time: 0.097034 Jan 19 16:10:20.908043 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 508/1080] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:20 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 20757 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:21.920220 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-50e5791c-ffb4-468f-a396-bd2342dd0cec tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:21.921156 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-50e5791c-ffb4-468f-a396-bd2342dd0cec tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:21.928020 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-50e5791c-ffb4-468f-a396-bd2342dd0cec tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:21.928460 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-50e5791c-ffb4-468f-a396-bd2342dd0cec tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:21.929378 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-50e5791c-ffb4-468f-a396-bd2342dd0cec tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:21.930105 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-50e5791c-ffb4-468f-a396-bd2342dd0cec tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:22.018507 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-50e5791c-ffb4-468f-a396-bd2342dd0cec tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 22896 microversion: 2.20 time: 0.102856 Jan 19 16:10:22.019404 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 573/1081] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:21 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 22896 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:23.030876 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-2152e062-3f85-45b8-886e-9f58cb432426 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:23.032090 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-2152e062-3f85-45b8-886e-9f58cb432426 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:23.039136 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2152e062-3f85-45b8-886e-9f58cb432426 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:23.039580 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2152e062-3f85-45b8-886e-9f58cb432426 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:23.040386 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2152e062-3f85-45b8-886e-9f58cb432426 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:23.040813 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2152e062-3f85-45b8-886e-9f58cb432426 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:23.113194 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-2152e062-3f85-45b8-886e-9f58cb432426 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 23803 microversion: 2.20 time: 0.086392 Jan 19 16:10:23.113849 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 509/1082] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:23 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 23803 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:24.125915 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-4c626830-c693-478d-b225-be87272289d1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:24.127653 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-4c626830-c693-478d-b225-be87272289d1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:24.134842 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4c626830-c693-478d-b225-be87272289d1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:24.135341 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4c626830-c693-478d-b225-be87272289d1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:24.136119 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4c626830-c693-478d-b225-be87272289d1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:24.136556 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4c626830-c693-478d-b225-be87272289d1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:24.220913 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-4c626830-c693-478d-b225-be87272289d1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 25367 microversion: 2.20 time: 0.099334 Jan 19 16:10:24.221583 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 574/1083] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:24 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 25367 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:10:25.234742 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e4205238-6ccc-4250-8dd6-b4347d3cbcfc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:25.235977 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-e4205238-6ccc-4250-8dd6-b4347d3cbcfc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:25.247646 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e4205238-6ccc-4250-8dd6-b4347d3cbcfc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:25.247646 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e4205238-6ccc-4250-8dd6-b4347d3cbcfc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:25.247646 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e4205238-6ccc-4250-8dd6-b4347d3cbcfc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:25.247646 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e4205238-6ccc-4250-8dd6-b4347d3cbcfc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:25.342685 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e4205238-6ccc-4250-8dd6-b4347d3cbcfc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 26845 microversion: 2.20 time: 0.112658 Jan 19 16:10:25.343383 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 510/1084] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:25 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 26845 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:26.354349 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-be282a24-55cb-431a-b555-b6f209f619d8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:26.355401 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-be282a24-55cb-431a-b555-b6f209f619d8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:26.362228 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-be282a24-55cb-431a-b555-b6f209f619d8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:26.362656 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-be282a24-55cb-431a-b555-b6f209f619d8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:26.363463 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-be282a24-55cb-431a-b555-b6f209f619d8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:26.363888 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-be282a24-55cb-431a-b555-b6f209f619d8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:26.455284 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-be282a24-55cb-431a-b555-b6f209f619d8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 27657 microversion: 2.20 time: 0.104831 Jan 19 16:10:26.456363 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 575/1085] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:26 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 27657 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:27.468039 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-78a1aee2-2a4e-497d-b8bf-b423160e5d9f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:27.469030 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-78a1aee2-2a4e-497d-b8bf-b423160e5d9f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:27.475845 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-78a1aee2-2a4e-497d-b8bf-b423160e5d9f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:27.476289 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-78a1aee2-2a4e-497d-b8bf-b423160e5d9f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:27.477065 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-78a1aee2-2a4e-497d-b8bf-b423160e5d9f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:27.477490 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-78a1aee2-2a4e-497d-b8bf-b423160e5d9f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:27.553043 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-78a1aee2-2a4e-497d-b8bf-b423160e5d9f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28019 microversion: 2.20 time: 0.089439 Jan 19 16:10:27.553795 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 511/1086] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:27 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28019 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:28.566015 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b9214680-fae2-476b-95aa-944b246301d4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:28.567029 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b9214680-fae2-476b-95aa-944b246301d4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:28.573914 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b9214680-fae2-476b-95aa-944b246301d4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:28.577789 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b9214680-fae2-476b-95aa-944b246301d4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:28.577789 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b9214680-fae2-476b-95aa-944b246301d4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:28.577789 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b9214680-fae2-476b-95aa-944b246301d4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:28.653369 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b9214680-fae2-476b-95aa-944b246301d4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28203 microversion: 2.20 time: 0.091208 Jan 19 16:10:28.654261 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 576/1087] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:28 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28203 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:29.665805 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-61a3eda4-ed5c-4066-b2cc-d71b6542970b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:29.666782 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-61a3eda4-ed5c-4066-b2cc-d71b6542970b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:29.674222 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-61a3eda4-ed5c-4066-b2cc-d71b6542970b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:29.674768 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-61a3eda4-ed5c-4066-b2cc-d71b6542970b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:29.675585 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-61a3eda4-ed5c-4066-b2cc-d71b6542970b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:29.675998 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-61a3eda4-ed5c-4066-b2cc-d71b6542970b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:29.737879 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-61a3eda4-ed5c-4066-b2cc-d71b6542970b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28203 microversion: 2.20 time: 0.075943 Jan 19 16:10:29.738549 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 512/1088] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:29 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28203 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:30.750048 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-7bf56428-8a50-485b-8ef6-cddca58d71c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:30.751094 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-7bf56428-8a50-485b-8ef6-cddca58d71c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:30.757847 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7bf56428-8a50-485b-8ef6-cddca58d71c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:30.758285 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7bf56428-8a50-485b-8ef6-cddca58d71c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:30.759081 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7bf56428-8a50-485b-8ef6-cddca58d71c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:30.759508 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7bf56428-8a50-485b-8ef6-cddca58d71c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:30.825561 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-7bf56428-8a50-485b-8ef6-cddca58d71c8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28203 microversion: 2.20 time: 0.079461 Jan 19 16:10:30.827833 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 577/1089] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:30 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28203 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:31.838458 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c5d3664b-c5ce-4b07-818d-ba039f21980b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:31.840823 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c5d3664b-c5ce-4b07-818d-ba039f21980b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:31.848110 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c5d3664b-c5ce-4b07-818d-ba039f21980b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:31.848575 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c5d3664b-c5ce-4b07-818d-ba039f21980b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:31.849968 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c5d3664b-c5ce-4b07-818d-ba039f21980b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:31.850697 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c5d3664b-c5ce-4b07-818d-ba039f21980b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:31.916573 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c5d3664b-c5ce-4b07-818d-ba039f21980b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28203 microversion: 2.20 time: 0.082127 Jan 19 16:10:31.917168 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 513/1090] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:31 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28203 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:32.928687 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-633d2110-d8b4-48eb-b234-058376acfdbf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:32.929598 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-633d2110-d8b4-48eb-b234-058376acfdbf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:32.936883 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-633d2110-d8b4-48eb-b234-058376acfdbf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:32.937321 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-633d2110-d8b4-48eb-b234-058376acfdbf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:32.938097 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-633d2110-d8b4-48eb-b234-058376acfdbf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:32.938529 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-633d2110-d8b4-48eb-b234-058376acfdbf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:32.998751 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-633d2110-d8b4-48eb-b234-058376acfdbf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28203 microversion: 2.20 time: 0.074013 Jan 19 16:10:32.999440 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 578/1091] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:32 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28203 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:34.010450 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-5cafe5b6-025b-4823-b5e8-d53eed2188f1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:34.011482 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-5cafe5b6-025b-4823-b5e8-d53eed2188f1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:34.018287 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5cafe5b6-025b-4823-b5e8-d53eed2188f1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:34.018732 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5cafe5b6-025b-4823-b5e8-d53eed2188f1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:34.019544 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5cafe5b6-025b-4823-b5e8-d53eed2188f1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:34.019975 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5cafe5b6-025b-4823-b5e8-d53eed2188f1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:34.086184 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-5cafe5b6-025b-4823-b5e8-d53eed2188f1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28203 microversion: 2.20 time: 0.079839 Jan 19 16:10:34.086848 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 514/1092] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:34 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28203 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:34.848439 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3e8885e4-f638-4944-927d-48ce6e96ddeb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:34.849437 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3e8885e4-f638-4944-927d-48ce6e96ddeb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:34.856312 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3e8885e4-f638-4944-927d-48ce6e96ddeb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:34.856756 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3e8885e4-f638-4944-927d-48ce6e96ddeb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:34.869847 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3e8885e4-f638-4944-927d-48ce6e96ddeb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:34.869847 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3e8885e4-f638-4944-927d-48ce6e96ddeb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:34.888688 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3e8885e4-f638-4944-927d-48ce6e96ddeb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044289 Jan 19 16:10:34.889253 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 579/1093] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:10:34 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:10:34.944648 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-61a49fce-b788-480d-97c3-d4766e6b1e13 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:34.945218 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-61a49fce-b788-480d-97c3-d4766e6b1e13 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:34.952242 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-61a49fce-b788-480d-97c3-d4766e6b1e13 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:34.952683 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-61a49fce-b788-480d-97c3-d4766e6b1e13 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:34.953462 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-61a49fce-b788-480d-97c3-d4766e6b1e13 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:34.953892 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-61a49fce-b788-480d-97c3-d4766e6b1e13 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:34.979499 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-61a49fce-b788-480d-97c3-d4766e6b1e13 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Going to try to terminate instance {{(pid=128875) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:10:35.098313 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-705fb48f-2952-4568-b75b-7aa3d4e046a2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:35.099243 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-705fb48f-2952-4568-b75b-7aa3d4e046a2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:35.105641 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-705fb48f-2952-4568-b75b-7aa3d4e046a2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:35.106086 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-705fb48f-2952-4568-b75b-7aa3d4e046a2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:35.106870 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-705fb48f-2952-4568-b75b-7aa3d4e046a2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:35.107328 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-705fb48f-2952-4568-b75b-7aa3d4e046a2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:35.178645 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-705fb48f-2952-4568-b75b-7aa3d4e046a2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28203 microversion: 2.20 time: 0.083909 Jan 19 16:10:35.183079 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 580/1094] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:35 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28203 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:10:35.267751 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-61a49fce-b788-480d-97c3-d4766e6b1e13 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 204 len: 0 microversion: 2.1 time: 0.326778 Jan 19 16:10:35.268337 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 515/1095] 10.222.0.58 () {58 vars in 1238 bytes} [Wed Jan 19 16:10:34 2022] DELETE /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:10:35.277144 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-cc062473-94e6-428d-aad2-5a39484422af tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:35.277835 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-cc062473-94e6-428d-aad2-5a39484422af tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:35.287099 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cc062473-94e6-428d-aad2-5a39484422af tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:35.287920 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cc062473-94e6-428d-aad2-5a39484422af tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:35.289349 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cc062473-94e6-428d-aad2-5a39484422af tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:35.290062 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cc062473-94e6-428d-aad2-5a39484422af tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:35.428981 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-cc062473-94e6-428d-aad2-5a39484422af tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:35.436586 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-cc062473-94e6-428d-aad2-5a39484422af tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1674 microversion: 2.1 time: 0.163793 Jan 19 16:10:35.437145 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 581/1096] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:10:35 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:10:36.193391 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-b1e79b03-3440-4f47-a375-93c73984f860 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:36.194383 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-b1e79b03-3440-4f47-a375-93c73984f860 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:36.203130 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b1e79b03-3440-4f47-a375-93c73984f860 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:36.203580 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b1e79b03-3440-4f47-a375-93c73984f860 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:36.204340 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b1e79b03-3440-4f47-a375-93c73984f860 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:36.204761 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b1e79b03-3440-4f47-a375-93c73984f860 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:36.270348 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-b1e79b03-3440-4f47-a375-93c73984f860 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28203 microversion: 2.20 time: 0.082415 Jan 19 16:10:36.271040 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 516/1097] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:36 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28203 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:36.453133 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ff7d8f84-1d8c-42b7-9782-273ae1e8f377 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:36.453709 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ff7d8f84-1d8c-42b7-9782-273ae1e8f377 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:36.460348 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ff7d8f84-1d8c-42b7-9782-273ae1e8f377 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:36.460803 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ff7d8f84-1d8c-42b7-9782-273ae1e8f377 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:36.461606 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ff7d8f84-1d8c-42b7-9782-273ae1e8f377 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:36.462045 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ff7d8f84-1d8c-42b7-9782-273ae1e8f377 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:36.605157 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ff7d8f84-1d8c-42b7-9782-273ae1e8f377 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:36.613643 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ff7d8f84-1d8c-42b7-9782-273ae1e8f377 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1674 microversion: 2.1 time: 0.164835 Jan 19 16:10:36.614382 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 582/1098] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:10:36 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:10:37.282387 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-4308a334-0b82-4f52-aa23-cbd97c16edc4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:37.284199 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-4308a334-0b82-4f52-aa23-cbd97c16edc4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:37.291590 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4308a334-0b82-4f52-aa23-cbd97c16edc4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:37.292331 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4308a334-0b82-4f52-aa23-cbd97c16edc4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:37.293353 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4308a334-0b82-4f52-aa23-cbd97c16edc4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:37.295307 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4308a334-0b82-4f52-aa23-cbd97c16edc4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:37.358664 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-4308a334-0b82-4f52-aa23-cbd97c16edc4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28203 microversion: 2.20 time: 0.079800 Jan 19 16:10:37.362703 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 517/1099] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:37 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28203 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:10:37.466216 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-21fb5e73-e97a-4ebc-939e-386c126ee88f req-a9ece499-60e6-4462-b43d-4f70366e942e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a", "name": "network-vif-deleted", "tag": "c7242af9-f303-413b-adb2-3e898621610a"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:37.467782 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:10:37.467782 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:10:37.475191 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-21fb5e73-e97a-4ebc-939e-386c126ee88f req-a9ece499-60e6-4462-b43d-4f70366e942e service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:37.480294 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-21fb5e73-e97a-4ebc-939e-386c126ee88f req-a9ece499-60e6-4462-b43d-4f70366e942e service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:37.487510 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-21fb5e73-e97a-4ebc-939e-386c126ee88f req-a9ece499-60e6-4462-b43d-4f70366e942e service nova] Creating event network-vif-deleted:c7242af9-f303-413b-adb2-3e898621610a for instance a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a on hv-cinder-82002 Jan 19 16:10:37.492438 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-21fb5e73-e97a-4ebc-939e-386c126ee88f req-a9ece499-60e6-4462-b43d-4f70366e942e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030169 Jan 19 16:10:37.493227 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 583/1100] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:10:37.632052 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-dd9209df-2b6a-4452-8506-f8086541c658 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:37.633198 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-dd9209df-2b6a-4452-8506-f8086541c658 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:37.643842 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-dd9209df-2b6a-4452-8506-f8086541c658 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:37.655500 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-dd9209df-2b6a-4452-8506-f8086541c658 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:37.656560 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-dd9209df-2b6a-4452-8506-f8086541c658 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:37.657034 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-dd9209df-2b6a-4452-8506-f8086541c658 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:37.741944 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-dd9209df-2b6a-4452-8506-f8086541c658 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:37.750516 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-dd9209df-2b6a-4452-8506-f8086541c658 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 200 len: 1323 microversion: 2.1 time: 0.122672 Jan 19 16:10:37.755699 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 518/1101] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:10:37 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 1323 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:10:38.370840 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-826c7375-8f9e-409b-85bb-4e142d935170 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:38.371869 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-826c7375-8f9e-409b-85bb-4e142d935170 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:38.377916 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-826c7375-8f9e-409b-85bb-4e142d935170 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:38.378415 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-826c7375-8f9e-409b-85bb-4e142d935170 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:38.379362 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-826c7375-8f9e-409b-85bb-4e142d935170 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:38.379772 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-826c7375-8f9e-409b-85bb-4e142d935170 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:38.452810 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-826c7375-8f9e-409b-85bb-4e142d935170 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28203 microversion: 2.20 time: 0.085941 Jan 19 16:10:38.454635 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 584/1102] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:38 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28203 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:38.768121 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-eb74c57f-cdb4-40ed-89a2-74cd4e81ce13 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:38.768731 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-eb74c57f-cdb4-40ed-89a2-74cd4e81ce13 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:38.778211 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-eb74c57f-cdb4-40ed-89a2-74cd4e81ce13 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:38.778665 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-eb74c57f-cdb4-40ed-89a2-74cd4e81ce13 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:38.779489 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-eb74c57f-cdb4-40ed-89a2-74cd4e81ce13 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:38.779927 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-eb74c57f-cdb4-40ed-89a2-74cd4e81ce13 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:38.793681 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.wsgi [None req-eb74c57f-cdb4-40ed-89a2-74cd4e81ce13 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] HTTP exception thrown: Instance a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a could not be found. Jan 19 16:10:38.794284 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-eb74c57f-cdb4-40ed-89a2-74cd4e81ce13 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Returning 404 to user: Instance a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a could not be found. {{(pid=128875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:10:38.795176 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-eb74c57f-cdb4-40ed-89a2-74cd4e81ce13 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 404 len: 111 microversion: 2.1 time: 0.031514 Jan 19 16:10:38.795872 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 519/1103] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:10:38 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:10:38.805075 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b6953a2a-96e2-4b2b-9fd0-62649c568293 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '.version_select at 0x7feff51944c0>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:38.926110 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b6953a2a-96e2-4b2b-9fd0-62649c568293 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1423543968" status: 202 len: 0 microversion: 2.1 time: 0.125208 Jan 19 16:10:38.928168 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 585/1104] 10.222.0.58 () {58 vars in 1220 bytes} [Wed Jan 19 16:10:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1423543968 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:39.465285 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c1577523-0886-4629-a887-b3cb47e2fc3c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:39.466606 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c1577523-0886-4629-a887-b3cb47e2fc3c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:39.473779 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c1577523-0886-4629-a887-b3cb47e2fc3c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:39.474360 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c1577523-0886-4629-a887-b3cb47e2fc3c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:39.475192 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c1577523-0886-4629-a887-b3cb47e2fc3c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:39.475620 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c1577523-0886-4629-a887-b3cb47e2fc3c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:39.542377 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c1577523-0886-4629-a887-b3cb47e2fc3c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28203 microversion: 2.20 time: 0.080942 Jan 19 16:10:39.546889 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 520/1105] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:39 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28203 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:39.709105 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5dc92f3f-d3cd-465e-85b9-94b11fe837fd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'create', calling method: .version_select at 0x7feff5db5550>, body: {"keypair": {"name": "tempest-keypair-469704561"}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:39.724186 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-5dc92f3f-d3cd-465e-85b9-94b11fe837fd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Getting quotas for project 803e4baba323417f977814e1d7250779. Resources: {'key_pairs'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:10:39.728018 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-5dc92f3f-d3cd-465e-85b9-94b11fe837fd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Getting quotas for user b7085f779daa4cd6acf0b38a942d9c7c and project 803e4baba323417f977814e1d7250779. Resources: {'key_pairs'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:10:39.924289 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-5dc92f3f-d3cd-465e-85b9-94b11fe837fd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Getting quotas for project 803e4baba323417f977814e1d7250779. Resources: {'key_pairs'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:10:39.928028 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-5dc92f3f-d3cd-465e-85b9-94b11fe837fd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Getting quotas for user b7085f779daa4cd6acf0b38a942d9c7c and project 803e4baba323417f977814e1d7250779. Resources: {'key_pairs'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:10:39.941476 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5dc92f3f-d3cd-465e-85b9-94b11fe837fd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.236620 Jan 19 16:10:39.942119 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 586/1106] 10.222.0.58 () {60 vars in 1157 bytes} [Wed Jan 19 16:10:39 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:10:40.554204 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-a4bdad3f-29a5-4348-853e-052c83b09b98 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:40.555500 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-a4bdad3f-29a5-4348-853e-052c83b09b98 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:40.563363 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a4bdad3f-29a5-4348-853e-052c83b09b98 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:40.563813 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a4bdad3f-29a5-4348-853e-052c83b09b98 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:40.564607 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a4bdad3f-29a5-4348-853e-052c83b09b98 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:40.565045 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a4bdad3f-29a5-4348-853e-052c83b09b98 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:40.629102 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-a4bdad3f-29a5-4348-853e-052c83b09b98 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28203 microversion: 2.20 time: 0.078849 Jan 19 16:10:40.630050 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 521/1107] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:40 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28203 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:41.641235 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a2dd6725-c2af-45ca-a827-166e53d15ccc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:41.642265 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a2dd6725-c2af-45ca-a827-166e53d15ccc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:41.648777 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a2dd6725-c2af-45ca-a827-166e53d15ccc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:41.649217 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a2dd6725-c2af-45ca-a827-166e53d15ccc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:41.650008 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a2dd6725-c2af-45ca-a827-166e53d15ccc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:41.650445 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a2dd6725-c2af-45ca-a827-166e53d15ccc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:41.724255 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a2dd6725-c2af-45ca-a827-166e53d15ccc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28494 microversion: 2.20 time: 0.087149 Jan 19 16:10:41.728284 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 587/1108] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:41 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28494 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:42.110263 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-0369eb35-db0b-4926-8d5b-d8e6f65cb682 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-950023275", "imageRef": "6d9c05bd-015a-44de-bd51-f744cb247e7a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e34f37f-5aee-4573-8888-6ef1a085de00"}], "security_groups": [{"name": "tempest-securitygroup--1144607446"}], "key_name": "tempest-keypair-469704561", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:42.209897 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.network.neutron [None req-0369eb35-db0b-4926-8d5b-d8e6f65cb682 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] validate_networks() for [('4e34f37f-5aee-4573-8888-6ef1a085de00', None, None, None, None, None)] {{(pid=128875) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:10:42.668918 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-0369eb35-db0b-4926-8d5b-d8e6f65cb682 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Flavor limits 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:10:42.669333 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-0369eb35-db0b-4926-8d5b-d8e6f65cb682 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Image limits 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:10:42.669799 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-0369eb35-db0b-4926-8d5b-d8e6f65cb682 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Flavor pref 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:10:42.670208 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-0369eb35-db0b-4926-8d5b-d8e6f65cb682 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Image pref 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:10:42.670609 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-0369eb35-db0b-4926-8d5b-d8e6f65cb682 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:10:42.679170 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0369eb35-db0b-4926-8d5b-d8e6f65cb682 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:42.679612 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0369eb35-db0b-4926-8d5b-d8e6f65cb682 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:42.680692 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0369eb35-db0b-4926-8d5b-d8e6f65cb682 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:42.681120 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0369eb35-db0b-4926-8d5b-d8e6f65cb682 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:42.697590 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-0369eb35-db0b-4926-8d5b-d8e6f65cb682 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Getting quotas for project 803e4baba323417f977814e1d7250779. Resources: {'ram', 'cores', 'instances'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:10:42.701948 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-0369eb35-db0b-4926-8d5b-d8e6f65cb682 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Getting quotas for user b7085f779daa4cd6acf0b38a942d9c7c and project 803e4baba323417f977814e1d7250779. Resources: {'ram', 'cores', 'instances'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:10:42.712352 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-0369eb35-db0b-4926-8d5b-d8e6f65cb682 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Going to run 1 instances... {{(pid=128875) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:10:42.714697 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-0369eb35-db0b-4926-8d5b-d8e6f65cb682 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6d9c05bd-015a-44de-bd51-f744cb247e7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:10:42.735834 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-fd267807-1fea-453b-b55a-c68c2b0c83c9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:42.736836 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-fd267807-1fea-453b-b55a-c68c2b0c83c9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:42.743843 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fd267807-1fea-453b-b55a-c68c2b0c83c9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:42.744290 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fd267807-1fea-453b-b55a-c68c2b0c83c9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:42.745070 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fd267807-1fea-453b-b55a-c68c2b0c83c9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:42.745501 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fd267807-1fea-453b-b55a-c68c2b0c83c9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:42.806689 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-fd267807-1fea-453b-b55a-c68c2b0c83c9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28494 microversion: 2.20 time: 0.074813 Jan 19 16:10:42.807539 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 588/1109] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:42 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28494 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:10:42.827522 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-0369eb35-db0b-4926-8d5b-d8e6f65cb682 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.721477 Jan 19 16:10:42.828124 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 522/1110] 10.222.0.58 () {60 vars in 1146 bytes} [Wed Jan 19 16:10:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:10:42.838769 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-40bcaed5-25e4-45bb-b433-968b9f5ccac2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:42.839487 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-40bcaed5-25e4-45bb-b433-968b9f5ccac2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:42.894356 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-40bcaed5-25e4-45bb-b433-968b9f5ccac2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:42.900894 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-40bcaed5-25e4-45bb-b433-968b9f5ccac2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0" status: 200 len: 1236 microversion: 2.1 time: 0.066523 Jan 19 16:10:42.901470 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 589/1111] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:10:42 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0 => generated 1236 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:10:43.818921 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-23cb1fc2-d1ee-4b0e-a4e3-cf21ddaf8842 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:43.819984 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-23cb1fc2-d1ee-4b0e-a4e3-cf21ddaf8842 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:43.826257 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-23cb1fc2-d1ee-4b0e-a4e3-cf21ddaf8842 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:43.826700 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-23cb1fc2-d1ee-4b0e-a4e3-cf21ddaf8842 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:43.827520 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-23cb1fc2-d1ee-4b0e-a4e3-cf21ddaf8842 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:43.828667 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-23cb1fc2-d1ee-4b0e-a4e3-cf21ddaf8842 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:43.909443 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-23cb1fc2-d1ee-4b0e-a4e3-cf21ddaf8842 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.094787 Jan 19 16:10:43.910123 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 523/1112] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:43 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:43.917755 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-2397c597-272c-4650-8c2c-1101e7178879 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:43.918885 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-2397c597-272c-4650-8c2c-1101e7178879 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:43.926092 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2397c597-272c-4650-8c2c-1101e7178879 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:43.926540 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2397c597-272c-4650-8c2c-1101e7178879 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:43.927407 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2397c597-272c-4650-8c2c-1101e7178879 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:43.927842 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2397c597-272c-4650-8c2c-1101e7178879 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:43.990235 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-2397c597-272c-4650-8c2c-1101e7178879 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:43.997647 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-2397c597-272c-4650-8c2c-1101e7178879 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0" status: 200 len: 1232 microversion: 2.1 time: 0.083668 Jan 19 16:10:43.998241 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 590/1113] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:10:43 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0 => generated 1232 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:10:44.922156 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-cb6553bf-4592-4997-a7a6-45380c7460df tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:44.923120 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-cb6553bf-4592-4997-a7a6-45380c7460df tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:44.930478 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cb6553bf-4592-4997-a7a6-45380c7460df tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:44.930926 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cb6553bf-4592-4997-a7a6-45380c7460df tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:44.937136 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cb6553bf-4592-4997-a7a6-45380c7460df tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:44.937136 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cb6553bf-4592-4997-a7a6-45380c7460df tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:45.004132 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-cb6553bf-4592-4997-a7a6-45380c7460df tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.085986 Jan 19 16:10:45.005453 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 524/1114] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:44 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:45.017839 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ee80beb3-f841-4506-8c95-19cb66d5082d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:45.018342 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ee80beb3-f841-4506-8c95-19cb66d5082d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:45.024659 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ee80beb3-f841-4506-8c95-19cb66d5082d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:45.025083 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ee80beb3-f841-4506-8c95-19cb66d5082d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:45.029421 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ee80beb3-f841-4506-8c95-19cb66d5082d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:45.029421 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ee80beb3-f841-4506-8c95-19cb66d5082d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:45.090917 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ee80beb3-f841-4506-8c95-19cb66d5082d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:45.099328 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ee80beb3-f841-4506-8c95-19cb66d5082d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0" status: 200 len: 1294 microversion: 2.1 time: 0.085611 Jan 19 16:10:45.099920 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 591/1115] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:10:45 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0 => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:10:46.017904 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-4314e259-747b-4a48-8f4d-85d0d262282e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:46.019080 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-4314e259-747b-4a48-8f4d-85d0d262282e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:46.026748 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4314e259-747b-4a48-8f4d-85d0d262282e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:46.027224 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4314e259-747b-4a48-8f4d-85d0d262282e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:46.028043 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4314e259-747b-4a48-8f4d-85d0d262282e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:46.028481 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4314e259-747b-4a48-8f4d-85d0d262282e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:46.099453 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-4314e259-747b-4a48-8f4d-85d0d262282e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.086793 Jan 19 16:10:46.103777 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 525/1116] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:46 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:46.117726 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-488556df-0936-41c8-850d-63b52d734ad1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:46.118562 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-488556df-0936-41c8-850d-63b52d734ad1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:46.126179 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-488556df-0936-41c8-850d-63b52d734ad1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:46.126650 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-488556df-0936-41c8-850d-63b52d734ad1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:46.127519 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-488556df-0936-41c8-850d-63b52d734ad1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:46.127960 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-488556df-0936-41c8-850d-63b52d734ad1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:46.303316 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-488556df-0936-41c8-850d-63b52d734ad1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:46.312073 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-488556df-0936-41c8-850d-63b52d734ad1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0" status: 200 len: 1362 microversion: 2.1 time: 0.198449 Jan 19 16:10:46.323028 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 592/1117] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:10:46 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:10:46.856657 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-5b36a9ba-b216-469a-9052-6089bbe89a11 req-e79908e2-0589-43e5-ae53-d864cdcf33ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20829277-9045-4a21-b255-9607610cf3f0", "tag": "a82ac16e-2982-490d-919b-a97fa8404828"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:46.860225 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:10:46.860225 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:10:46.878814 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-5b36a9ba-b216-469a-9052-6089bbe89a11 req-e79908e2-0589-43e5-ae53-d864cdcf33ee service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:46.880321 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-5b36a9ba-b216-469a-9052-6089bbe89a11 req-e79908e2-0589-43e5-ae53-d864cdcf33ee service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:46.895890 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-5b36a9ba-b216-469a-9052-6089bbe89a11 req-e79908e2-0589-43e5-ae53-d864cdcf33ee service nova] Creating event network-changed:a82ac16e-2982-490d-919b-a97fa8404828 for instance 20829277-9045-4a21-b255-9607610cf3f0 on hv-cinder-82002 Jan 19 16:10:46.903293 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-5b36a9ba-b216-469a-9052-6089bbe89a11 req-e79908e2-0589-43e5-ae53-d864cdcf33ee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061402 Jan 19 16:10:46.904030 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 526/1118] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:10:47.111008 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-0da9568e-0483-4f68-9714-3ac20e5db106 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:47.112011 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-0da9568e-0483-4f68-9714-3ac20e5db106 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:47.118622 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0da9568e-0483-4f68-9714-3ac20e5db106 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:47.119618 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0da9568e-0483-4f68-9714-3ac20e5db106 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:47.119889 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0da9568e-0483-4f68-9714-3ac20e5db106 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:47.120346 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0da9568e-0483-4f68-9714-3ac20e5db106 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:47.190415 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-0da9568e-0483-4f68-9714-3ac20e5db106 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.082942 Jan 19 16:10:47.191126 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 593/1119] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:47 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:47.334823 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6a605ed3-909e-4818-9f91-efb6cd56b41b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:47.335706 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-6a605ed3-909e-4818-9f91-efb6cd56b41b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:47.342107 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6a605ed3-909e-4818-9f91-efb6cd56b41b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:47.342584 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6a605ed3-909e-4818-9f91-efb6cd56b41b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:47.344170 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6a605ed3-909e-4818-9f91-efb6cd56b41b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:47.344436 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6a605ed3-909e-4818-9f91-efb6cd56b41b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:47.616363 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6a605ed3-909e-4818-9f91-efb6cd56b41b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:47.624368 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6a605ed3-909e-4818-9f91-efb6cd56b41b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0" status: 200 len: 1362 microversion: 2.1 time: 0.294681 Jan 19 16:10:47.625745 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 527/1120] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:10:47 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0 => generated 1362 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:10:48.205207 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5366ce0a-c7c3-4a15-83c9-5525c1ad4eb4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:48.206304 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5366ce0a-c7c3-4a15-83c9-5525c1ad4eb4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:48.214096 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5366ce0a-c7c3-4a15-83c9-5525c1ad4eb4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:48.214532 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5366ce0a-c7c3-4a15-83c9-5525c1ad4eb4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:48.215368 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5366ce0a-c7c3-4a15-83c9-5525c1ad4eb4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:48.215795 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5366ce0a-c7c3-4a15-83c9-5525c1ad4eb4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:48.300673 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5366ce0a-c7c3-4a15-83c9-5525c1ad4eb4 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.102223 Jan 19 16:10:48.301678 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 594/1121] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:48 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:48.644030 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-86cd6320-a06d-4a7c-9b9b-da091d223a84 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:48.644610 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-86cd6320-a06d-4a7c-9b9b-da091d223a84 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:48.650930 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-86cd6320-a06d-4a7c-9b9b-da091d223a84 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:48.651393 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-86cd6320-a06d-4a7c-9b9b-da091d223a84 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:48.652159 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-86cd6320-a06d-4a7c-9b9b-da091d223a84 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:48.652593 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-86cd6320-a06d-4a7c-9b9b-da091d223a84 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:48.789787 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-86cd6320-a06d-4a7c-9b9b-da091d223a84 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:48.797037 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-86cd6320-a06d-4a7c-9b9b-da091d223a84 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0" status: 200 len: 1362 microversion: 2.1 time: 0.157412 Jan 19 16:10:48.797604 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 528/1122] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:10:48 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:10:49.313700 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-de8e6bfe-90b3-4a12-b52e-46d06ff4955d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:49.314707 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-de8e6bfe-90b3-4a12-b52e-46d06ff4955d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:49.322289 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-de8e6bfe-90b3-4a12-b52e-46d06ff4955d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:49.322738 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-de8e6bfe-90b3-4a12-b52e-46d06ff4955d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:49.323582 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-de8e6bfe-90b3-4a12-b52e-46d06ff4955d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:49.324017 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-de8e6bfe-90b3-4a12-b52e-46d06ff4955d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:49.438531 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-de8e6bfe-90b3-4a12-b52e-46d06ff4955d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.128247 Jan 19 16:10:49.439535 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 595/1123] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:49 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:49.815178 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f37be780-6358-4680-9c93-b150e2e113df tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:49.815785 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-f37be780-6358-4680-9c93-b150e2e113df tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:49.823174 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f37be780-6358-4680-9c93-b150e2e113df tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:49.823774 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f37be780-6358-4680-9c93-b150e2e113df tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:49.824579 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f37be780-6358-4680-9c93-b150e2e113df tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:49.825015 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f37be780-6358-4680-9c93-b150e2e113df tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:49.979622 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-f37be780-6358-4680-9c93-b150e2e113df tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:49.992352 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f37be780-6358-4680-9c93-b150e2e113df tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0" status: 200 len: 1362 microversion: 2.1 time: 0.180871 Jan 19 16:10:49.993338 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 529/1124] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:10:49 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:10:50.451735 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-02264623-0326-478b-a95f-e1b4f4147d74 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:50.453440 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-02264623-0326-478b-a95f-e1b4f4147d74 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:50.460885 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-02264623-0326-478b-a95f-e1b4f4147d74 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:50.461329 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-02264623-0326-478b-a95f-e1b4f4147d74 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:50.462114 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-02264623-0326-478b-a95f-e1b4f4147d74 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:50.462546 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-02264623-0326-478b-a95f-e1b4f4147d74 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:50.526003 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-02264623-0326-478b-a95f-e1b4f4147d74 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.078582 Jan 19 16:10:50.526665 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 596/1125] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:50 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:51.016028 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f8ee2bd4-6827-4275-946b-526154d042cf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:51.017163 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-f8ee2bd4-6827-4275-946b-526154d042cf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:51.028688 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f8ee2bd4-6827-4275-946b-526154d042cf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:51.029266 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f8ee2bd4-6827-4275-946b-526154d042cf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:51.030346 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f8ee2bd4-6827-4275-946b-526154d042cf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:51.031148 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f8ee2bd4-6827-4275-946b-526154d042cf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:51.196175 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-f8ee2bd4-6827-4275-946b-526154d042cf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:51.209650 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f8ee2bd4-6827-4275-946b-526154d042cf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0" status: 200 len: 1362 microversion: 2.1 time: 0.200629 Jan 19 16:10:51.210557 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 530/1126] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:10:51 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:10:51.539912 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-0517a634-ab70-4244-aaa4-5795a12e8232 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:51.541016 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-0517a634-ab70-4244-aaa4-5795a12e8232 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:51.548626 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0517a634-ab70-4244-aaa4-5795a12e8232 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:51.549064 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0517a634-ab70-4244-aaa4-5795a12e8232 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:51.549841 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0517a634-ab70-4244-aaa4-5795a12e8232 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:51.550276 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0517a634-ab70-4244-aaa4-5795a12e8232 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:51.622028 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-0517a634-ab70-4244-aaa4-5795a12e8232 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.086901 Jan 19 16:10:51.623122 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 597/1127] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:51 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:52.226851 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d5e8c22a-4926-44f5-b37a-82d80acd572c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:52.227505 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d5e8c22a-4926-44f5-b37a-82d80acd572c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:52.233879 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d5e8c22a-4926-44f5-b37a-82d80acd572c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:52.234319 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d5e8c22a-4926-44f5-b37a-82d80acd572c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:52.235119 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d5e8c22a-4926-44f5-b37a-82d80acd572c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:52.235545 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d5e8c22a-4926-44f5-b37a-82d80acd572c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:52.365996 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d5e8c22a-4926-44f5-b37a-82d80acd572c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:52.373426 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d5e8c22a-4926-44f5-b37a-82d80acd572c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0" status: 200 len: 1362 microversion: 2.1 time: 0.150216 Jan 19 16:10:52.374011 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 531/1128] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:10:52 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:10:52.634672 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-cfc4ee59-2179-4f2c-99fd-d01ab8b2e5c6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:52.635910 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-cfc4ee59-2179-4f2c-99fd-d01ab8b2e5c6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:52.643016 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cfc4ee59-2179-4f2c-99fd-d01ab8b2e5c6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:52.643475 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cfc4ee59-2179-4f2c-99fd-d01ab8b2e5c6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:52.644929 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cfc4ee59-2179-4f2c-99fd-d01ab8b2e5c6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:52.644929 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cfc4ee59-2179-4f2c-99fd-d01ab8b2e5c6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:52.720386 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-cfc4ee59-2179-4f2c-99fd-d01ab8b2e5c6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.089875 Jan 19 16:10:52.721051 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 598/1129] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:52 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:53.095273 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-8f4d3c17-8c66-4b72-8891-4100b6c626d7 req-91e1473d-b76e-4ff0-b396-45abe73ea36e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20829277-9045-4a21-b255-9607610cf3f0", "name": "network-vif-plugged", "status": "completed", "tag": "a82ac16e-2982-490d-919b-a97fa8404828"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:53.099572 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:10:53.099572 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:10:53.107090 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-8f4d3c17-8c66-4b72-8891-4100b6c626d7 req-91e1473d-b76e-4ff0-b396-45abe73ea36e service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:53.107537 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-8f4d3c17-8c66-4b72-8891-4100b6c626d7 req-91e1473d-b76e-4ff0-b396-45abe73ea36e service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:53.127241 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-8f4d3c17-8c66-4b72-8891-4100b6c626d7 req-91e1473d-b76e-4ff0-b396-45abe73ea36e service nova] Creating event network-vif-plugged:a82ac16e-2982-490d-919b-a97fa8404828 for instance 20829277-9045-4a21-b255-9607610cf3f0 on hv-cinder-82002 Jan 19 16:10:53.133312 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-8f4d3c17-8c66-4b72-8891-4100b6c626d7 req-91e1473d-b76e-4ff0-b396-45abe73ea36e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042926 Jan 19 16:10:53.133861 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 532/1130] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:10:53.391639 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3255ef04-ad6a-484a-9ac6-dde9b48b6104 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:53.392470 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3255ef04-ad6a-484a-9ac6-dde9b48b6104 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:53.400360 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3255ef04-ad6a-484a-9ac6-dde9b48b6104 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:53.401242 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3255ef04-ad6a-484a-9ac6-dde9b48b6104 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:53.402256 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3255ef04-ad6a-484a-9ac6-dde9b48b6104 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:53.402996 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3255ef04-ad6a-484a-9ac6-dde9b48b6104 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:53.575121 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-3255ef04-ad6a-484a-9ac6-dde9b48b6104 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:53.587709 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3255ef04-ad6a-484a-9ac6-dde9b48b6104 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0" status: 200 len: 1362 microversion: 2.1 time: 0.200769 Jan 19 16:10:53.588350 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 599/1131] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:10:53 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:10:53.733877 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-16f10d8a-1dc7-4b79-b9d7-76c2a5ec2408 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:53.734887 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-16f10d8a-1dc7-4b79-b9d7-76c2a5ec2408 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:53.741248 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-16f10d8a-1dc7-4b79-b9d7-76c2a5ec2408 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:53.741691 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-16f10d8a-1dc7-4b79-b9d7-76c2a5ec2408 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:53.742560 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-16f10d8a-1dc7-4b79-b9d7-76c2a5ec2408 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:53.743016 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-16f10d8a-1dc7-4b79-b9d7-76c2a5ec2408 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:53.808065 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-16f10d8a-1dc7-4b79-b9d7-76c2a5ec2408 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.078639 Jan 19 16:10:53.808722 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 533/1132] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:53 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:54.605193 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-4f928987-5083-465d-9d68-4188162f0c78 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:54.606619 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-4f928987-5083-465d-9d68-4188162f0c78 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:54.614716 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4f928987-5083-465d-9d68-4188162f0c78 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:54.615265 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4f928987-5083-465d-9d68-4188162f0c78 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:54.616109 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4f928987-5083-465d-9d68-4188162f0c78 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:54.616578 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4f928987-5083-465d-9d68-4188162f0c78 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:54.784533 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-4f928987-5083-465d-9d68-4188162f0c78 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:54.792601 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-4f928987-5083-465d-9d68-4188162f0c78 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0" status: 200 len: 1362 microversion: 2.1 time: 0.191812 Jan 19 16:10:54.793201 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 600/1133] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:10:54 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:10:54.821497 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-78328c68-e8ea-4fcd-b090-e31d4b08144f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:54.825544 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-78328c68-e8ea-4fcd-b090-e31d4b08144f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:54.830761 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-78328c68-e8ea-4fcd-b090-e31d4b08144f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:54.831200 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-78328c68-e8ea-4fcd-b090-e31d4b08144f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:54.832006 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-78328c68-e8ea-4fcd-b090-e31d4b08144f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:54.832434 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-78328c68-e8ea-4fcd-b090-e31d4b08144f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:54.899539 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-78328c68-e8ea-4fcd-b090-e31d4b08144f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.082081 Jan 19 16:10:54.900206 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 534/1134] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:54 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:55.811085 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-4b4e291d-b2e0-4ade-bda4-45302da56259 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:55.813079 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-4b4e291d-b2e0-4ade-bda4-45302da56259 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:55.819191 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4b4e291d-b2e0-4ade-bda4-45302da56259 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:55.819640 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4b4e291d-b2e0-4ade-bda4-45302da56259 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:55.820447 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4b4e291d-b2e0-4ade-bda4-45302da56259 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:55.820862 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4b4e291d-b2e0-4ade-bda4-45302da56259 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:55.914159 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-22ccdf0c-f8f7-4568-9418-6c0b5a59e914 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:55.915175 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-22ccdf0c-f8f7-4568-9418-6c0b5a59e914 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:55.924582 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-22ccdf0c-f8f7-4568-9418-6c0b5a59e914 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:55.924582 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-22ccdf0c-f8f7-4568-9418-6c0b5a59e914 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:55.925398 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-22ccdf0c-f8f7-4568-9418-6c0b5a59e914 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:55.925832 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-22ccdf0c-f8f7-4568-9418-6c0b5a59e914 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:55.987760 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-4b4e291d-b2e0-4ade-bda4-45302da56259 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:10:55.993924 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-22ccdf0c-f8f7-4568-9418-6c0b5a59e914 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.084186 Jan 19 16:10:55.995348 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 535/1135] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:55 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:10:55.995557 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-4b4e291d-b2e0-4ade-bda4-45302da56259 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0" status: 200 len: 1547 microversion: 2.1 time: 0.188139 Jan 19 16:10:55.996224 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 601/1136] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:10:55 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0 => generated 1547 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:10:56.023171 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-0b753b23-f3a9-40ae-a2b7-eb52195e2553 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:10:56.023744 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-0b753b23-f3a9-40ae-a2b7-eb52195e2553 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:56.031885 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0b753b23-f3a9-40ae-a2b7-eb52195e2553 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:56.032326 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0b753b23-f3a9-40ae-a2b7-eb52195e2553 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:56.033110 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0b753b23-f3a9-40ae-a2b7-eb52195e2553 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:56.033536 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-0b753b23-f3a9-40ae-a2b7-eb52195e2553 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:56.130580 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-0b753b23-f3a9-40ae-a2b7-eb52195e2553 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113117 Jan 19 16:10:56.131481 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 536/1137] 10.222.0.58 () {58 vars in 1274 bytes} [Wed Jan 19 16:10:56 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:10:57.005820 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5ac864b9-2db7-4150-9458-3ea23cade224 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:57.006756 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5ac864b9-2db7-4150-9458-3ea23cade224 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:57.013310 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5ac864b9-2db7-4150-9458-3ea23cade224 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:57.013759 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5ac864b9-2db7-4150-9458-3ea23cade224 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:57.014590 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5ac864b9-2db7-4150-9458-3ea23cade224 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:57.015003 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5ac864b9-2db7-4150-9458-3ea23cade224 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:57.076226 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5ac864b9-2db7-4150-9458-3ea23cade224 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.074107 Jan 19 16:10:57.080766 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 602/1138] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:57 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:57.209656 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-9d4124a7-615f-436b-a395-4442e15fb418 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:57.210689 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-9d4124a7-615f-436b-a395-4442e15fb418 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:57.217320 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9d4124a7-615f-436b-a395-4442e15fb418 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:57.217846 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9d4124a7-615f-436b-a395-4442e15fb418 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:57.218794 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9d4124a7-615f-436b-a395-4442e15fb418 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:57.219535 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9d4124a7-615f-436b-a395-4442e15fb418 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:57.278844 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-9d4124a7-615f-436b-a395-4442e15fb418 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 14 microversion: 2.1 time: 0.073175 Jan 19 16:10:57.279538 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 537/1139] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:10:57 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:10:57.334303 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-a01d1e75-72ac-4dbc-962f-8ac3345d0ef5 req-ae74fa5a-bf7c-4561-9f43-748679e379b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20829277-9045-4a21-b255-9607610cf3f0", "tag": "a82ac16e-2982-490d-919b-a97fa8404828"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:57.336640 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:10:57.336640 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:10:57.344287 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-a01d1e75-72ac-4dbc-962f-8ac3345d0ef5 req-ae74fa5a-bf7c-4561-9f43-748679e379b6 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:57.344287 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-a01d1e75-72ac-4dbc-962f-8ac3345d0ef5 req-ae74fa5a-bf7c-4561-9f43-748679e379b6 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:57.354486 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-a01d1e75-72ac-4dbc-962f-8ac3345d0ef5 req-ae74fa5a-bf7c-4561-9f43-748679e379b6 service nova] Creating event network-changed:a82ac16e-2982-490d-919b-a97fa8404828 for instance 20829277-9045-4a21-b255-9607610cf3f0 on hv-cinder-82002 Jan 19 16:10:57.359925 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-a01d1e75-72ac-4dbc-962f-8ac3345d0ef5 req-ae74fa5a-bf7c-4561-9f43-748679e379b6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151747 Jan 19 16:10:57.360520 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 603/1140] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:10:58.090642 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-259cdb6a-5ce3-473e-9de5-1417b17459a0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:58.091082 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-259cdb6a-5ce3-473e-9de5-1417b17459a0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:58.099380 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-259cdb6a-5ce3-473e-9de5-1417b17459a0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:58.099851 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-259cdb6a-5ce3-473e-9de5-1417b17459a0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:58.100752 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-259cdb6a-5ce3-473e-9de5-1417b17459a0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:58.101185 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-259cdb6a-5ce3-473e-9de5-1417b17459a0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:58.164600 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-259cdb6a-5ce3-473e-9de5-1417b17459a0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.078687 Jan 19 16:10:58.165529 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 538/1141] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:58 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:58.291194 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-28d4362c-8090-4a2a-9dd1-c8f49821a31d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:58.292360 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-28d4362c-8090-4a2a-9dd1-c8f49821a31d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:58.299595 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-28d4362c-8090-4a2a-9dd1-c8f49821a31d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:58.302008 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-28d4362c-8090-4a2a-9dd1-c8f49821a31d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:58.302008 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-28d4362c-8090-4a2a-9dd1-c8f49821a31d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:58.302008 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-28d4362c-8090-4a2a-9dd1-c8f49821a31d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:58.368642 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-28d4362c-8090-4a2a-9dd1-c8f49821a31d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 14 microversion: 2.1 time: 0.081939 Jan 19 16:10:58.371797 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 604/1142] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:10:58 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:10:59.178087 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c43354a9-d5a9-4e6f-b756-e357b723bf90 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:59.179162 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c43354a9-d5a9-4e6f-b756-e357b723bf90 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:59.186321 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c43354a9-d5a9-4e6f-b756-e357b723bf90 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:59.186763 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c43354a9-d5a9-4e6f-b756-e357b723bf90 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:59.187569 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c43354a9-d5a9-4e6f-b756-e357b723bf90 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:59.188002 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c43354a9-d5a9-4e6f-b756-e357b723bf90 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:59.248146 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c43354a9-d5a9-4e6f-b756-e357b723bf90 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.074981 Jan 19 16:10:59.248779 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 539/1143] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:10:59 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:10:59.379904 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-74afe577-c76a-43cf-951d-500440bb1ae4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:10:59.380895 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-74afe577-c76a-43cf-951d-500440bb1ae4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:10:59.388159 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-74afe577-c76a-43cf-951d-500440bb1ae4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:59.388596 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-74afe577-c76a-43cf-951d-500440bb1ae4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:59.389374 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-74afe577-c76a-43cf-951d-500440bb1ae4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:10:59.389807 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-74afe577-c76a-43cf-951d-500440bb1ae4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:10:59.453666 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-74afe577-c76a-43cf-951d-500440bb1ae4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 14 microversion: 2.1 time: 0.076980 Jan 19 16:10:59.454304 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 605/1144] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:10:59 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:11:00.260445 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d0d64ae5-61d7-4398-8d26-4cb8c59f5a17 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:00.261446 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d0d64ae5-61d7-4398-8d26-4cb8c59f5a17 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:00.268451 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d0d64ae5-61d7-4398-8d26-4cb8c59f5a17 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:00.268901 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d0d64ae5-61d7-4398-8d26-4cb8c59f5a17 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:00.269683 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d0d64ae5-61d7-4398-8d26-4cb8c59f5a17 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:00.270146 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d0d64ae5-61d7-4398-8d26-4cb8c59f5a17 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:00.343936 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d0d64ae5-61d7-4398-8d26-4cb8c59f5a17 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.086977 Jan 19 16:11:00.344685 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 540/1145] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:11:00 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:11:00.465335 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5c595ceb-d430-4c42-8cff-da46bb6d0ee2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:00.466236 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5c595ceb-d430-4c42-8cff-da46bb6d0ee2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:00.473609 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5c595ceb-d430-4c42-8cff-da46bb6d0ee2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:00.474046 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5c595ceb-d430-4c42-8cff-da46bb6d0ee2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:00.474821 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5c595ceb-d430-4c42-8cff-da46bb6d0ee2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:00.475306 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5c595ceb-d430-4c42-8cff-da46bb6d0ee2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:00.540961 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5c595ceb-d430-4c42-8cff-da46bb6d0ee2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 14 microversion: 2.1 time: 0.079662 Jan 19 16:11:00.541631 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 606/1146] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:00 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:11:01.357060 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-7578aabd-74e1-4347-976d-eacd7146072a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:01.358060 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-7578aabd-74e1-4347-976d-eacd7146072a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:01.365491 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7578aabd-74e1-4347-976d-eacd7146072a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:01.365935 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7578aabd-74e1-4347-976d-eacd7146072a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:01.366716 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7578aabd-74e1-4347-976d-eacd7146072a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:01.367214 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7578aabd-74e1-4347-976d-eacd7146072a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:01.437772 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-7578aabd-74e1-4347-976d-eacd7146072a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.083804 Jan 19 16:11:01.438104 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 541/1147] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:11:01 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:11:01.553349 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-1e683504-44cc-45f5-be3b-7e742d67a0dc tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:01.554335 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-1e683504-44cc-45f5-be3b-7e742d67a0dc tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:01.561491 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1e683504-44cc-45f5-be3b-7e742d67a0dc tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:01.562551 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1e683504-44cc-45f5-be3b-7e742d67a0dc tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:01.563357 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1e683504-44cc-45f5-be3b-7e742d67a0dc tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:01.563791 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1e683504-44cc-45f5-be3b-7e742d67a0dc tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:01.627814 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-1e683504-44cc-45f5-be3b-7e742d67a0dc tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 14 microversion: 2.1 time: 0.078392 Jan 19 16:11:01.628451 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 607/1148] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:01 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:11:02.451266 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-25b85c21-584e-47e3-b299-deffd4f908be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:02.452252 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-25b85c21-584e-47e3-b299-deffd4f908be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:02.459769 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-25b85c21-584e-47e3-b299-deffd4f908be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:02.460195 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-25b85c21-584e-47e3-b299-deffd4f908be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:02.460970 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-25b85c21-584e-47e3-b299-deffd4f908be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:02.461399 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-25b85c21-584e-47e3-b299-deffd4f908be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:02.535539 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-25b85c21-584e-47e3-b299-deffd4f908be tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.088247 Jan 19 16:11:02.536189 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 542/1149] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:11:02 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:11:02.639189 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-12f0275b-3361-4d9d-8353-2f6cd79d0cdd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:02.640836 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-12f0275b-3361-4d9d-8353-2f6cd79d0cdd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:02.648045 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-12f0275b-3361-4d9d-8353-2f6cd79d0cdd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:02.648493 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-12f0275b-3361-4d9d-8353-2f6cd79d0cdd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:02.649292 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-12f0275b-3361-4d9d-8353-2f6cd79d0cdd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:02.649723 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-12f0275b-3361-4d9d-8353-2f6cd79d0cdd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:02.711054 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-12f0275b-3361-4d9d-8353-2f6cd79d0cdd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 14 microversion: 2.1 time: 0.075683 Jan 19 16:11:02.711634 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 608/1150] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:02 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:11:03.547652 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-fb5738ad-14f9-441a-a2f0-b149d6dada31 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:03.548645 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-fb5738ad-14f9-441a-a2f0-b149d6dada31 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:03.555747 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fb5738ad-14f9-441a-a2f0-b149d6dada31 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:03.556215 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fb5738ad-14f9-441a-a2f0-b149d6dada31 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:03.556990 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fb5738ad-14f9-441a-a2f0-b149d6dada31 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:03.557420 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fb5738ad-14f9-441a-a2f0-b149d6dada31 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:03.616875 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-fb5738ad-14f9-441a-a2f0-b149d6dada31 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.073271 Jan 19 16:11:03.617520 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 543/1151] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:11:03 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:11:03.722897 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-186261b9-c263-4c63-b2ea-1581ec0f8bc0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:03.723978 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-186261b9-c263-4c63-b2ea-1581ec0f8bc0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:03.730842 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-186261b9-c263-4c63-b2ea-1581ec0f8bc0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:03.731322 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-186261b9-c263-4c63-b2ea-1581ec0f8bc0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:03.732099 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-186261b9-c263-4c63-b2ea-1581ec0f8bc0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:03.732534 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-186261b9-c263-4c63-b2ea-1581ec0f8bc0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:03.789655 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-186261b9-c263-4c63-b2ea-1581ec0f8bc0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 14 microversion: 2.1 time: 0.071182 Jan 19 16:11:03.790308 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 609/1152] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:03 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:11:04.630467 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-30c44548-a844-4066-8b31-2d9de1283d41 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:04.631498 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-30c44548-a844-4066-8b31-2d9de1283d41 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:04.638354 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-30c44548-a844-4066-8b31-2d9de1283d41 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:04.638794 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-30c44548-a844-4066-8b31-2d9de1283d41 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:04.639603 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-30c44548-a844-4066-8b31-2d9de1283d41 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:04.640033 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-30c44548-a844-4066-8b31-2d9de1283d41 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:04.707277 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-30c44548-a844-4066-8b31-2d9de1283d41 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.080641 Jan 19 16:11:04.708102 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 544/1153] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:11:04 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:11:04.800897 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-99ff2187-943b-4c9b-b964-64632d0663e1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:04.801892 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-99ff2187-943b-4c9b-b964-64632d0663e1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:04.809518 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-99ff2187-943b-4c9b-b964-64632d0663e1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:04.809961 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-99ff2187-943b-4c9b-b964-64632d0663e1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:04.810760 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-99ff2187-943b-4c9b-b964-64632d0663e1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:04.811213 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-99ff2187-943b-4c9b-b964-64632d0663e1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:04.887158 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-99ff2187-943b-4c9b-b964-64632d0663e1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 14 microversion: 2.1 time: 0.090573 Jan 19 16:11:04.887793 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 610/1154] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:04 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:11:05.720025 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-78145094-b32a-486f-8ed6-9128321d4a4b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:05.721028 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-78145094-b32a-486f-8ed6-9128321d4a4b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:05.727860 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-78145094-b32a-486f-8ed6-9128321d4a4b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:05.728295 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-78145094-b32a-486f-8ed6-9128321d4a4b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:05.729060 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-78145094-b32a-486f-8ed6-9128321d4a4b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:05.729483 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-78145094-b32a-486f-8ed6-9128321d4a4b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:05.789617 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-78145094-b32a-486f-8ed6-9128321d4a4b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.074130 Jan 19 16:11:05.790266 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 545/1155] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:11:05 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:11:05.898750 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-96def1d8-72c5-420a-af54-60358d279be3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:05.899695 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-96def1d8-72c5-420a-af54-60358d279be3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:05.907486 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-96def1d8-72c5-420a-af54-60358d279be3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:05.907927 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-96def1d8-72c5-420a-af54-60358d279be3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:05.908743 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-96def1d8-72c5-420a-af54-60358d279be3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:05.909170 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-96def1d8-72c5-420a-af54-60358d279be3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:05.966078 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-96def1d8-72c5-420a-af54-60358d279be3 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 14 microversion: 2.1 time: 0.071292 Jan 19 16:11:05.966756 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 611/1156] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:05 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:11:06.802663 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-20e4e0e9-1dbd-49d8-97c1-554ead339e7a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:06.803688 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-20e4e0e9-1dbd-49d8-97c1-554ead339e7a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:06.811006 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-20e4e0e9-1dbd-49d8-97c1-554ead339e7a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:06.811457 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-20e4e0e9-1dbd-49d8-97c1-554ead339e7a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:06.812257 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-20e4e0e9-1dbd-49d8-97c1-554ead339e7a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:06.812690 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-20e4e0e9-1dbd-49d8-97c1-554ead339e7a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:06.890477 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-20e4e0e9-1dbd-49d8-97c1-554ead339e7a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.092173 Jan 19 16:11:06.891074 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 546/1157] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:11:06 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:11:06.977483 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3216127a-ee2f-48db-ab6f-67b9fffa6cb9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:06.978514 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3216127a-ee2f-48db-ab6f-67b9fffa6cb9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:06.986380 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3216127a-ee2f-48db-ab6f-67b9fffa6cb9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:06.986822 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3216127a-ee2f-48db-ab6f-67b9fffa6cb9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:06.987642 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3216127a-ee2f-48db-ab6f-67b9fffa6cb9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:06.988073 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3216127a-ee2f-48db-ab6f-67b9fffa6cb9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:07.050752 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3216127a-ee2f-48db-ab6f-67b9fffa6cb9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 14 microversion: 2.1 time: 0.077241 Jan 19 16:11:07.051473 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 612/1158] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:06 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:11:07.902929 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c6d0ccba-0a25-4341-b85b-f69b36e04f35 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:07.903992 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c6d0ccba-0a25-4341-b85b-f69b36e04f35 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:07.912098 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c6d0ccba-0a25-4341-b85b-f69b36e04f35 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:07.912538 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c6d0ccba-0a25-4341-b85b-f69b36e04f35 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:07.913328 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c6d0ccba-0a25-4341-b85b-f69b36e04f35 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:07.913762 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c6d0ccba-0a25-4341-b85b-f69b36e04f35 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:07.978099 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c6d0ccba-0a25-4341-b85b-f69b36e04f35 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.079206 Jan 19 16:11:07.978819 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 547/1159] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:11:07 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:11:08.063000 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b4ffea22-26c3-413b-9013-bb16d1a39a7e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:08.064940 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b4ffea22-26c3-413b-9013-bb16d1a39a7e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:08.072297 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b4ffea22-26c3-413b-9013-bb16d1a39a7e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:08.072759 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b4ffea22-26c3-413b-9013-bb16d1a39a7e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:08.073533 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b4ffea22-26c3-413b-9013-bb16d1a39a7e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:08.073965 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b4ffea22-26c3-413b-9013-bb16d1a39a7e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:08.145441 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b4ffea22-26c3-413b-9013-bb16d1a39a7e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 4153 microversion: 2.1 time: 0.086509 Jan 19 16:11:08.146090 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 613/1160] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:08 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 4153 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:11:08.992267 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-476e9b78-872f-4df9-947c-6c772a4327c2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:08.993272 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-476e9b78-872f-4df9-947c-6c772a4327c2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:09.000324 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-476e9b78-872f-4df9-947c-6c772a4327c2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:09.000795 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-476e9b78-872f-4df9-947c-6c772a4327c2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:09.001578 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-476e9b78-872f-4df9-947c-6c772a4327c2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:09.002003 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-476e9b78-872f-4df9-947c-6c772a4327c2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:09.081552 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-476e9b78-872f-4df9-947c-6c772a4327c2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.094479 Jan 19 16:11:09.082225 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 548/1161] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:11:08 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:11:09.156948 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-20796864-8478-42f8-922b-cd37828f9b18 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:09.158549 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-20796864-8478-42f8-922b-cd37828f9b18 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:09.165700 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-20796864-8478-42f8-922b-cd37828f9b18 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:09.166167 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-20796864-8478-42f8-922b-cd37828f9b18 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:09.166954 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-20796864-8478-42f8-922b-cd37828f9b18 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:09.167774 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-20796864-8478-42f8-922b-cd37828f9b18 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:09.255723 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-20796864-8478-42f8-922b-cd37828f9b18 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 14890 microversion: 2.1 time: 0.102432 Jan 19 16:11:09.256293 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 614/1162] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:09 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 14890 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:10.094341 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-1998ca63-685b-4dad-84e0-51fb9da127ec tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:10.095520 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-1998ca63-685b-4dad-84e0-51fb9da127ec tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:10.103151 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1998ca63-685b-4dad-84e0-51fb9da127ec tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:10.103601 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1998ca63-685b-4dad-84e0-51fb9da127ec tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:10.104398 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1998ca63-685b-4dad-84e0-51fb9da127ec tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:10.104823 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1998ca63-685b-4dad-84e0-51fb9da127ec tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:10.175856 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-1998ca63-685b-4dad-84e0-51fb9da127ec tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.085531 Jan 19 16:11:10.176521 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 549/1163] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:11:10 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:11:10.267621 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-cdf1d2b9-3471-4fe7-8706-822ce0b8b11e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:10.268641 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-cdf1d2b9-3471-4fe7-8706-822ce0b8b11e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:10.275697 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cdf1d2b9-3471-4fe7-8706-822ce0b8b11e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:10.276141 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cdf1d2b9-3471-4fe7-8706-822ce0b8b11e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:10.276927 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cdf1d2b9-3471-4fe7-8706-822ce0b8b11e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:10.277357 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cdf1d2b9-3471-4fe7-8706-822ce0b8b11e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:10.348292 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-cdf1d2b9-3471-4fe7-8706-822ce0b8b11e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 18498 microversion: 2.1 time: 0.084620 Jan 19 16:11:10.349086 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 615/1164] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:10 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 18498 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:11.189311 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-fdb48df7-7f93-447f-b7b4-11f18ab1c74b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:11.190374 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-fdb48df7-7f93-447f-b7b4-11f18ab1c74b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:11.198358 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fdb48df7-7f93-447f-b7b4-11f18ab1c74b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:11.198804 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fdb48df7-7f93-447f-b7b4-11f18ab1c74b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:11.199632 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fdb48df7-7f93-447f-b7b4-11f18ab1c74b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:11.200065 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fdb48df7-7f93-447f-b7b4-11f18ab1c74b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:11.267622 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-fdb48df7-7f93-447f-b7b4-11f18ab1c74b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.082449 Jan 19 16:11:11.269172 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 550/1165] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:11:11 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:11:11.360150 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-297f811d-148e-4d29-b6be-8b230f1d554b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:11.361144 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-297f811d-148e-4d29-b6be-8b230f1d554b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:11.368964 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-297f811d-148e-4d29-b6be-8b230f1d554b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:11.369444 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-297f811d-148e-4d29-b6be-8b230f1d554b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:11.370236 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-297f811d-148e-4d29-b6be-8b230f1d554b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:11.370663 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-297f811d-148e-4d29-b6be-8b230f1d554b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:11.446760 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-297f811d-148e-4d29-b6be-8b230f1d554b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 19342 microversion: 2.1 time: 0.090358 Jan 19 16:11:11.447411 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 616/1166] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:11 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 19342 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:12.281959 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-223568af-87ae-4275-8d7e-c812dc0ea5e7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:12.282957 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-223568af-87ae-4275-8d7e-c812dc0ea5e7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:12.289953 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-223568af-87ae-4275-8d7e-c812dc0ea5e7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:12.290390 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-223568af-87ae-4275-8d7e-c812dc0ea5e7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:12.291206 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-223568af-87ae-4275-8d7e-c812dc0ea5e7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:12.291632 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-223568af-87ae-4275-8d7e-c812dc0ea5e7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:12.362727 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-223568af-87ae-4275-8d7e-c812dc0ea5e7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.085093 Jan 19 16:11:12.363437 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 551/1167] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:11:12 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:11:12.458825 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8d8834a5-67be-4aea-a9ba-f63f85c949dd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:12.460021 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-8d8834a5-67be-4aea-a9ba-f63f85c949dd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:12.468517 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8d8834a5-67be-4aea-a9ba-f63f85c949dd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:12.468962 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8d8834a5-67be-4aea-a9ba-f63f85c949dd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:12.469744 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8d8834a5-67be-4aea-a9ba-f63f85c949dd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:12.470170 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8d8834a5-67be-4aea-a9ba-f63f85c949dd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:12.543197 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-8d8834a5-67be-4aea-a9ba-f63f85c949dd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 22070 microversion: 2.1 time: 0.088104 Jan 19 16:11:12.543803 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 617/1168] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:12 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 22070 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:13.375357 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-2ee0b85b-6c6e-4c5f-825c-1621e5e87942 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:13.377010 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-2ee0b85b-6c6e-4c5f-825c-1621e5e87942 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:13.384967 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2ee0b85b-6c6e-4c5f-825c-1621e5e87942 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:13.385536 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2ee0b85b-6c6e-4c5f-825c-1621e5e87942 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:13.386395 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2ee0b85b-6c6e-4c5f-825c-1621e5e87942 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:13.386840 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2ee0b85b-6c6e-4c5f-825c-1621e5e87942 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:13.460373 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-2ee0b85b-6c6e-4c5f-825c-1621e5e87942 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 28662 microversion: 2.20 time: 0.089055 Jan 19 16:11:13.461142 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 552/1169] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:11:13 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 28662 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:11:13.559964 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-15647f1f-0b8f-4f13-aee6-a334814c55c2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:13.561247 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-15647f1f-0b8f-4f13-aee6-a334814c55c2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:13.569593 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-15647f1f-0b8f-4f13-aee6-a334814c55c2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:13.570032 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-15647f1f-0b8f-4f13-aee6-a334814c55c2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:13.570826 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-15647f1f-0b8f-4f13-aee6-a334814c55c2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:13.571292 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-15647f1f-0b8f-4f13-aee6-a334814c55c2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:13.643361 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-15647f1f-0b8f-4f13-aee6-a334814c55c2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 23234 microversion: 2.1 time: 0.092719 Jan 19 16:11:13.644060 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 618/1170] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:13 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 23234 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:14.473790 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d4a88505-4615-49b5-b412-da7321ba0245 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:14.474727 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d4a88505-4615-49b5-b412-da7321ba0245 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:14.482157 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d4a88505-4615-49b5-b412-da7321ba0245 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:14.482603 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d4a88505-4615-49b5-b412-da7321ba0245 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:14.483440 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d4a88505-4615-49b5-b412-da7321ba0245 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:14.483873 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d4a88505-4615-49b5-b412-da7321ba0245 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:14.559828 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d4a88505-4615-49b5-b412-da7321ba0245 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 29764 microversion: 2.20 time: 0.090670 Jan 19 16:11:14.560499 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 553/1171] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:11:14 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 29764 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:11:14.655124 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8391a510-ec26-4b76-9dd3-30837de1bc6a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:14.656151 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-8391a510-ec26-4b76-9dd3-30837de1bc6a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:14.664904 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8391a510-ec26-4b76-9dd3-30837de1bc6a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:14.665344 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8391a510-ec26-4b76-9dd3-30837de1bc6a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:14.666132 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8391a510-ec26-4b76-9dd3-30837de1bc6a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:14.666562 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8391a510-ec26-4b76-9dd3-30837de1bc6a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:14.741899 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-8391a510-ec26-4b76-9dd3-30837de1bc6a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 24955 microversion: 2.1 time: 0.090618 Jan 19 16:11:14.742500 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 619/1172] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:14 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 24955 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:11:15.572873 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-faf1b8fd-e37e-4b09-b3aa-8fc43c294e54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:15.573925 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-faf1b8fd-e37e-4b09-b3aa-8fc43c294e54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:15.581411 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-faf1b8fd-e37e-4b09-b3aa-8fc43c294e54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:15.587447 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-faf1b8fd-e37e-4b09-b3aa-8fc43c294e54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:15.587447 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-faf1b8fd-e37e-4b09-b3aa-8fc43c294e54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:15.587447 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-faf1b8fd-e37e-4b09-b3aa-8fc43c294e54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:15.659667 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-faf1b8fd-e37e-4b09-b3aa-8fc43c294e54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 31777 microversion: 2.20 time: 0.090714 Jan 19 16:11:15.660346 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 554/1173] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:11:15 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 31777 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:11:15.755190 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-053b2b85-214d-4e4a-8687-36b596346027 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:15.756178 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-053b2b85-214d-4e4a-8687-36b596346027 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:15.762908 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-053b2b85-214d-4e4a-8687-36b596346027 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:15.763390 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-053b2b85-214d-4e4a-8687-36b596346027 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:15.764179 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-053b2b85-214d-4e4a-8687-36b596346027 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:15.764611 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-053b2b85-214d-4e4a-8687-36b596346027 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:15.839166 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-053b2b85-214d-4e4a-8687-36b596346027 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 26276 microversion: 2.1 time: 0.088880 Jan 19 16:11:15.839768 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 620/1174] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:15 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 26276 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:16.672452 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-52ab23ac-c0ed-450f-af45-84cbadbd3a77 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:16.673427 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-52ab23ac-c0ed-450f-af45-84cbadbd3a77 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:16.679744 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-52ab23ac-c0ed-450f-af45-84cbadbd3a77 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:16.680448 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-52ab23ac-c0ed-450f-af45-84cbadbd3a77 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:16.681203 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-52ab23ac-c0ed-450f-af45-84cbadbd3a77 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:16.681627 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-52ab23ac-c0ed-450f-af45-84cbadbd3a77 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:16.753092 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-52ab23ac-c0ed-450f-af45-84cbadbd3a77 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 33288 microversion: 2.20 time: 0.085097 Jan 19 16:11:16.754383 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 555/1175] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:11:16 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 33288 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:11:16.852084 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ed542bae-61f6-49a6-89e1-abb7d2ccee6e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:16.853108 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ed542bae-61f6-49a6-89e1-abb7d2ccee6e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:16.861288 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ed542bae-61f6-49a6-89e1-abb7d2ccee6e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:16.861665 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ed542bae-61f6-49a6-89e1-abb7d2ccee6e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:16.862453 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ed542bae-61f6-49a6-89e1-abb7d2ccee6e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:16.862883 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ed542bae-61f6-49a6-89e1-abb7d2ccee6e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:16.940978 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ed542bae-61f6-49a6-89e1-abb7d2ccee6e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 27307 microversion: 2.1 time: 0.092945 Jan 19 16:11:16.941670 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 621/1176] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:16 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 27307 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:17.765429 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-7d46c773-a1cd-4385-9384-b51ed850df53 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:17.766430 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-7d46c773-a1cd-4385-9384-b51ed850df53 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:17.773275 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7d46c773-a1cd-4385-9384-b51ed850df53 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:17.773722 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7d46c773-a1cd-4385-9384-b51ed850df53 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:17.774491 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7d46c773-a1cd-4385-9384-b51ed850df53 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:17.774920 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7d46c773-a1cd-4385-9384-b51ed850df53 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:17.852500 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-7d46c773-a1cd-4385-9384-b51ed850df53 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 34166 microversion: 2.20 time: 0.087358 Jan 19 16:11:17.852500 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 556/1177] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:11:17 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 34166 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:11:17.955266 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-85b7f12b-0656-4587-8782-a36523961a38 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:17.956201 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-85b7f12b-0656-4587-8782-a36523961a38 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:17.963438 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-85b7f12b-0656-4587-8782-a36523961a38 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:17.963879 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-85b7f12b-0656-4587-8782-a36523961a38 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:17.964705 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-85b7f12b-0656-4587-8782-a36523961a38 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:17.965115 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-85b7f12b-0656-4587-8782-a36523961a38 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:18.057643 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-85b7f12b-0656-4587-8782-a36523961a38 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 27773 microversion: 2.1 time: 0.108172 Jan 19 16:11:18.058637 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 622/1178] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:17 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 27773 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:11:18.861917 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-29c9765b-bded-4154-827f-5aaf8ea58084 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:18.862833 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-29c9765b-bded-4154-827f-5aaf8ea58084 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:18.869876 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-29c9765b-bded-4154-827f-5aaf8ea58084 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:18.870312 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-29c9765b-bded-4154-827f-5aaf8ea58084 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:18.871117 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-29c9765b-bded-4154-827f-5aaf8ea58084 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:18.871547 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-29c9765b-bded-4154-827f-5aaf8ea58084 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:18.948187 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-29c9765b-bded-4154-827f-5aaf8ea58084 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 35293 microversion: 2.20 time: 0.090787 Jan 19 16:11:18.948837 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 557/1179] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:11:18 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 35293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:11:19.070269 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a66f84da-495d-481c-9fe0-a3143008c97e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:19.071293 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a66f84da-495d-481c-9fe0-a3143008c97e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:19.078182 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a66f84da-495d-481c-9fe0-a3143008c97e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:19.078623 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a66f84da-495d-481c-9fe0-a3143008c97e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:19.079563 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a66f84da-495d-481c-9fe0-a3143008c97e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:19.079994 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a66f84da-495d-481c-9fe0-a3143008c97e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:19.163546 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a66f84da-495d-481c-9fe0-a3143008c97e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28196 microversion: 2.1 time: 0.097103 Jan 19 16:11:19.164177 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 623/1180] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:19 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28196 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:19.961388 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-1fcff130-9497-43ac-89e3-b3331389cb43 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:19.962296 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-1fcff130-9497-43ac-89e3-b3331389cb43 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:19.969245 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1fcff130-9497-43ac-89e3-b3331389cb43 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:19.969680 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1fcff130-9497-43ac-89e3-b3331389cb43 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:19.970443 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1fcff130-9497-43ac-89e3-b3331389cb43 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:19.970869 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1fcff130-9497-43ac-89e3-b3331389cb43 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:20.050898 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-1fcff130-9497-43ac-89e3-b3331389cb43 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 36802 microversion: 2.20 time: 0.093754 Jan 19 16:11:20.051584 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 558/1181] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:11:19 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 36802 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:11:20.176313 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-bd290bc0-503a-4b60-8048-04c01e2dad7a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:20.177305 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-bd290bc0-503a-4b60-8048-04c01e2dad7a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:20.184617 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bd290bc0-503a-4b60-8048-04c01e2dad7a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:20.185062 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bd290bc0-503a-4b60-8048-04c01e2dad7a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:20.185832 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bd290bc0-503a-4b60-8048-04c01e2dad7a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:20.186261 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bd290bc0-503a-4b60-8048-04c01e2dad7a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:20.246094 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-bd290bc0-503a-4b60-8048-04c01e2dad7a tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28196 microversion: 2.1 time: 0.074238 Jan 19 16:11:20.246695 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 624/1182] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:20 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28196 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:21.064218 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-de2e2803-8302-49ff-8603-6fa298eb487d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:21.065227 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-de2e2803-8302-49ff-8603-6fa298eb487d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:21.072424 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-de2e2803-8302-49ff-8603-6fa298eb487d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:21.072864 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-de2e2803-8302-49ff-8603-6fa298eb487d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:21.073651 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-de2e2803-8302-49ff-8603-6fa298eb487d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:21.074074 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-de2e2803-8302-49ff-8603-6fa298eb487d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:21.145797 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-de2e2803-8302-49ff-8603-6fa298eb487d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 38221 microversion: 2.20 time: 0.085992 Jan 19 16:11:21.146484 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 559/1183] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:11:21 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 38221 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:11:21.259105 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a373ad52-2c3d-45cc-a72c-39067933d607 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:21.260113 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a373ad52-2c3d-45cc-a72c-39067933d607 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:21.266687 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a373ad52-2c3d-45cc-a72c-39067933d607 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:21.267164 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a373ad52-2c3d-45cc-a72c-39067933d607 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:21.267946 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a373ad52-2c3d-45cc-a72c-39067933d607 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:21.268377 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a373ad52-2c3d-45cc-a72c-39067933d607 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:21.329760 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a373ad52-2c3d-45cc-a72c-39067933d607 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28196 microversion: 2.1 time: 0.074529 Jan 19 16:11:21.330336 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 625/1184] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:21 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28196 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:22.158933 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-4c386777-3ceb-4073-aa53-937a420d957c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:22.160027 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-4c386777-3ceb-4073-aa53-937a420d957c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:22.166906 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4c386777-3ceb-4073-aa53-937a420d957c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:22.167371 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4c386777-3ceb-4073-aa53-937a420d957c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:22.168144 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4c386777-3ceb-4073-aa53-937a420d957c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:22.168572 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4c386777-3ceb-4073-aa53-937a420d957c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:22.228103 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-4c386777-3ceb-4073-aa53-937a420d957c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 38221 microversion: 2.20 time: 0.073775 Jan 19 16:11:22.228753 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 560/1185] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:11:22 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 38221 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:11:22.341886 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-9b06f63f-1e40-432e-849f-fd18cdba2623 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:22.342986 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-9b06f63f-1e40-432e-849f-fd18cdba2623 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:22.350098 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9b06f63f-1e40-432e-849f-fd18cdba2623 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:22.350549 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9b06f63f-1e40-432e-849f-fd18cdba2623 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:22.351370 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9b06f63f-1e40-432e-849f-fd18cdba2623 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:22.351803 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9b06f63f-1e40-432e-849f-fd18cdba2623 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:22.414288 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-9b06f63f-1e40-432e-849f-fd18cdba2623 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28196 microversion: 2.1 time: 0.076229 Jan 19 16:11:22.414872 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 626/1186] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:22 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28196 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:23.240473 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-b74b3982-0195-46e9-aa18-d156e7d64aaf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:23.241598 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-b74b3982-0195-46e9-aa18-d156e7d64aaf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:23.248416 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b74b3982-0195-46e9-aa18-d156e7d64aaf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:23.248862 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b74b3982-0195-46e9-aa18-d156e7d64aaf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:23.249642 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b74b3982-0195-46e9-aa18-d156e7d64aaf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:23.250074 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b74b3982-0195-46e9-aa18-d156e7d64aaf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:23.311795 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-b74b3982-0195-46e9-aa18-d156e7d64aaf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 38221 microversion: 2.20 time: 0.075281 Jan 19 16:11:23.312461 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 561/1187] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:11:23 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 38221 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:11:23.426810 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-023b3012-a5c0-4d2b-8aea-f0afa36cc17e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:23.427744 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-023b3012-a5c0-4d2b-8aea-f0afa36cc17e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:23.435197 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-023b3012-a5c0-4d2b-8aea-f0afa36cc17e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:23.435644 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-023b3012-a5c0-4d2b-8aea-f0afa36cc17e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:23.436426 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-023b3012-a5c0-4d2b-8aea-f0afa36cc17e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:23.436858 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-023b3012-a5c0-4d2b-8aea-f0afa36cc17e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:23.495459 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-023b3012-a5c0-4d2b-8aea-f0afa36cc17e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28196 microversion: 2.1 time: 0.073161 Jan 19 16:11:23.496117 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 627/1188] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:23 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28196 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:24.324900 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ddcec6b5-0ee2-4b7a-908f-1725145130cf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:24.325900 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-ddcec6b5-0ee2-4b7a-908f-1725145130cf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:24.333302 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ddcec6b5-0ee2-4b7a-908f-1725145130cf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:24.333745 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ddcec6b5-0ee2-4b7a-908f-1725145130cf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:24.334522 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ddcec6b5-0ee2-4b7a-908f-1725145130cf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:24.334952 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ddcec6b5-0ee2-4b7a-908f-1725145130cf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:24.395195 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-ddcec6b5-0ee2-4b7a-908f-1725145130cf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 38221 microversion: 2.20 time: 0.074229 Jan 19 16:11:24.395851 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 562/1189] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:11:24 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 38221 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:11:24.508354 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c7852cc0-e918-4c08-be98-8ccfcb1b2932 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:24.509352 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c7852cc0-e918-4c08-be98-8ccfcb1b2932 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:24.516190 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c7852cc0-e918-4c08-be98-8ccfcb1b2932 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:24.516636 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c7852cc0-e918-4c08-be98-8ccfcb1b2932 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:24.517426 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c7852cc0-e918-4c08-be98-8ccfcb1b2932 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:24.518449 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c7852cc0-e918-4c08-be98-8ccfcb1b2932 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:24.583676 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c7852cc0-e918-4c08-be98-8ccfcb1b2932 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28196 microversion: 2.1 time: 0.079062 Jan 19 16:11:24.584501 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 628/1190] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:24 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28196 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:25.407631 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-10dfa9f1-43e7-4b95-8264-fee5a3556cbf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:25.408563 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-10dfa9f1-43e7-4b95-8264-fee5a3556cbf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:25.415556 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-10dfa9f1-43e7-4b95-8264-fee5a3556cbf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:25.416000 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-10dfa9f1-43e7-4b95-8264-fee5a3556cbf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:25.416778 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-10dfa9f1-43e7-4b95-8264-fee5a3556cbf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:25.417202 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-10dfa9f1-43e7-4b95-8264-fee5a3556cbf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:25.489765 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-10dfa9f1-43e7-4b95-8264-fee5a3556cbf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 200 len: 38364 microversion: 2.20 time: 0.086446 Jan 19 16:11:25.490398 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 563/1191] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:11:25 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 38364 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:11:25.500834 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3b03db6c-024c-4340-acd0-b842cdc5f53b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:25.501397 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3b03db6c-024c-4340-acd0-b842cdc5f53b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:25.508878 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3b03db6c-024c-4340-acd0-b842cdc5f53b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:25.509459 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3b03db6c-024c-4340-acd0-b842cdc5f53b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:25.510071 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3b03db6c-024c-4340-acd0-b842cdc5f53b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:25.510497 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3b03db6c-024c-4340-acd0-b842cdc5f53b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:25.535301 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3b03db6c-024c-4340-acd0-b842cdc5f53b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/ips" status: 200 len: 151 microversion: 2.20 time: 0.038614 Jan 19 16:11:25.535962 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 629/1192] 10.222.0.58 () {60 vars in 1288 bytes} [Wed Jan 19 16:11:25 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:25.595398 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-57c69537-ccea-4a6e-bfea-f76369fd3d65 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:25.656959 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-57c69537-ccea-4a6e-bfea-f76369fd3d65 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:25.656959 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-57c69537-ccea-4a6e-bfea-f76369fd3d65 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:25.656959 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-57c69537-ccea-4a6e-bfea-f76369fd3d65 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:25.656959 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-57c69537-ccea-4a6e-bfea-f76369fd3d65 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:25.658207 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-57c69537-ccea-4a6e-bfea-f76369fd3d65 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:25.668833 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-57c69537-ccea-4a6e-bfea-f76369fd3d65 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28196 microversion: 2.1 time: 0.077387 Jan 19 16:11:25.669530 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 564/1193] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:25 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28196 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:26.680084 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ea4ba7dc-bcf7-4bf2-bda9-8fa8f1876661 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:26.681253 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ea4ba7dc-bcf7-4bf2-bda9-8fa8f1876661 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:26.688186 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ea4ba7dc-bcf7-4bf2-bda9-8fa8f1876661 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:26.688635 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ea4ba7dc-bcf7-4bf2-bda9-8fa8f1876661 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:26.689418 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ea4ba7dc-bcf7-4bf2-bda9-8fa8f1876661 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:26.689855 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ea4ba7dc-bcf7-4bf2-bda9-8fa8f1876661 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:26.757162 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ea4ba7dc-bcf7-4bf2-bda9-8fa8f1876661 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28196 microversion: 2.1 time: 0.080575 Jan 19 16:11:26.757816 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 630/1194] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:26 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28196 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:27.768401 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-8b2f1223-f591-4614-a09c-69b1d9861cff tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:27.769986 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8b2f1223-f591-4614-a09c-69b1d9861cff tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:27.776850 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8b2f1223-f591-4614-a09c-69b1d9861cff tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:27.777296 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8b2f1223-f591-4614-a09c-69b1d9861cff tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:27.778070 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8b2f1223-f591-4614-a09c-69b1d9861cff tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:27.778504 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8b2f1223-f591-4614-a09c-69b1d9861cff tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:27.839767 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-8b2f1223-f591-4614-a09c-69b1d9861cff tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28196 microversion: 2.1 time: 0.075227 Jan 19 16:11:27.840658 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 565/1195] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:27 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28196 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:11:27.994068 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-02e12eaa-4180-4c9f-bd00-2c51e3a421af tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:27.994606 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-02e12eaa-4180-4c9f-bd00-2c51e3a421af tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:28.001421 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-02e12eaa-4180-4c9f-bd00-2c51e3a421af tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:28.001858 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-02e12eaa-4180-4c9f-bd00-2c51e3a421af tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:28.002624 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-02e12eaa-4180-4c9f-bd00-2c51e3a421af tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:28.003079 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-02e12eaa-4180-4c9f-bd00-2c51e3a421af tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:28.026312 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.objects.instance [None req-02e12eaa-4180-4c9f-bd00-2c51e3a421af tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lazy-loading 'flavor' on Instance uuid 9c1319b6-bda0-474e-bf40-08f9106fa169 {{(pid=128876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:11:28.586379 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-02e12eaa-4180-4c9f-bd00-2c51e3a421af tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 202 len: 0 microversion: 2.20 time: 0.596306 Jan 19 16:11:28.587181 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 631/1196] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:11:27 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 0 bytes in 598 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 19 16:11:28.596151 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-bb041d71-a323-45ec-9e7c-1bb00d22b358 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:28.597617 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-bb041d71-a323-45ec-9e7c-1bb00d22b358 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:28.606697 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bb041d71-a323-45ec-9e7c-1bb00d22b358 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:28.609215 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bb041d71-a323-45ec-9e7c-1bb00d22b358 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:28.609215 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bb041d71-a323-45ec-9e7c-1bb00d22b358 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:28.609215 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bb041d71-a323-45ec-9e7c-1bb00d22b358 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:28.742811 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-bb041d71-a323-45ec-9e7c-1bb00d22b358 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:28.750579 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-bb041d71-a323-45ec-9e7c-1bb00d22b358 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:28.752098 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-bb041d71-a323-45ec-9e7c-1bb00d22b358 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:28.753314 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-bb041d71-a323-45ec-9e7c-1bb00d22b358 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1723 microversion: 2.20 time: 0.161793 Jan 19 16:11:28.753892 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 566/1197] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:28 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:11:28.852203 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-0ba860f3-7142-4b78-8476-cedb1a27a828 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:28.853113 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-0ba860f3-7142-4b78-8476-cedb1a27a828 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:28.859342 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0ba860f3-7142-4b78-8476-cedb1a27a828 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:28.859783 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0ba860f3-7142-4b78-8476-cedb1a27a828 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:28.860546 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0ba860f3-7142-4b78-8476-cedb1a27a828 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:28.860973 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0ba860f3-7142-4b78-8476-cedb1a27a828 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:28.920303 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-0ba860f3-7142-4b78-8476-cedb1a27a828 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28196 microversion: 2.1 time: 0.072710 Jan 19 16:11:28.920941 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 632/1198] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:28 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28196 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:29.772044 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-933b0aa0-c510-443a-be96-dc1f60056107 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:29.772704 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-933b0aa0-c510-443a-be96-dc1f60056107 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:29.779073 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-933b0aa0-c510-443a-be96-dc1f60056107 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:29.779513 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-933b0aa0-c510-443a-be96-dc1f60056107 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:29.780275 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-933b0aa0-c510-443a-be96-dc1f60056107 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:29.780697 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-933b0aa0-c510-443a-be96-dc1f60056107 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:29.912030 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-933b0aa0-c510-443a-be96-dc1f60056107 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:29.919818 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-933b0aa0-c510-443a-be96-dc1f60056107 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:29.921313 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-933b0aa0-c510-443a-be96-dc1f60056107 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:29.922478 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-933b0aa0-c510-443a-be96-dc1f60056107 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1723 microversion: 2.20 time: 0.154763 Jan 19 16:11:29.923044 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 567/1199] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:29 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:11:29.932555 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f1188af4-dd6d-416b-93aa-5d207ad0d418 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:29.933602 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f1188af4-dd6d-416b-93aa-5d207ad0d418 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:29.940475 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f1188af4-dd6d-416b-93aa-5d207ad0d418 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:29.940918 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f1188af4-dd6d-416b-93aa-5d207ad0d418 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:29.941696 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f1188af4-dd6d-416b-93aa-5d207ad0d418 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:29.942671 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f1188af4-dd6d-416b-93aa-5d207ad0d418 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:30.005973 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f1188af4-dd6d-416b-93aa-5d207ad0d418 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28196 microversion: 2.1 time: 0.077556 Jan 19 16:11:30.006889 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 633/1200] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:29 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28196 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:30.940979 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-50a210bc-80e6-47db-81d8-0dc1c4a95ba8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:30.941596 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-50a210bc-80e6-47db-81d8-0dc1c4a95ba8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:30.947960 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-50a210bc-80e6-47db-81d8-0dc1c4a95ba8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:30.948405 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-50a210bc-80e6-47db-81d8-0dc1c4a95ba8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:30.949182 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-50a210bc-80e6-47db-81d8-0dc1c4a95ba8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:30.949662 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-50a210bc-80e6-47db-81d8-0dc1c4a95ba8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:31.017961 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-4d83cbb6-c0c3-46bb-966f-55062dfcf09e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:31.019080 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-4d83cbb6-c0c3-46bb-966f-55062dfcf09e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:31.026644 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4d83cbb6-c0c3-46bb-966f-55062dfcf09e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:31.026941 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4d83cbb6-c0c3-46bb-966f-55062dfcf09e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:31.027747 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4d83cbb6-c0c3-46bb-966f-55062dfcf09e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:31.028184 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4d83cbb6-c0c3-46bb-966f-55062dfcf09e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:31.076693 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-50a210bc-80e6-47db-81d8-0dc1c4a95ba8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:31.084993 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-50a210bc-80e6-47db-81d8-0dc1c4a95ba8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:31.086509 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-50a210bc-80e6-47db-81d8-0dc1c4a95ba8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:31.087834 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-50a210bc-80e6-47db-81d8-0dc1c4a95ba8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1723 microversion: 2.20 time: 0.150685 Jan 19 16:11:31.088405 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 568/1201] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:30 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:11:31.103319 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-4d83cbb6-c0c3-46bb-966f-55062dfcf09e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28196 microversion: 2.1 time: 0.089140 Jan 19 16:11:31.104091 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 634/1202] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:31 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28196 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:11:32.105508 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-221f4719-057f-4731-9823-438e854e041c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:32.106084 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-221f4719-057f-4731-9823-438e854e041c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:32.112587 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-221f4719-057f-4731-9823-438e854e041c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:32.113063 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-221f4719-057f-4731-9823-438e854e041c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:32.114516 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-221f4719-057f-4731-9823-438e854e041c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:32.114950 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-221f4719-057f-4731-9823-438e854e041c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:32.115415 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-902bb7bc-8a14-450d-a2bf-1042bae6ba2e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:32.116418 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-902bb7bc-8a14-450d-a2bf-1042bae6ba2e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:32.123387 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-902bb7bc-8a14-450d-a2bf-1042bae6ba2e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:32.123829 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-902bb7bc-8a14-450d-a2bf-1042bae6ba2e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:32.124625 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-902bb7bc-8a14-450d-a2bf-1042bae6ba2e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:32.125057 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-902bb7bc-8a14-450d-a2bf-1042bae6ba2e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:32.183940 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-902bb7bc-8a14-450d-a2bf-1042bae6ba2e tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28196 microversion: 2.1 time: 0.072973 Jan 19 16:11:32.185442 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 635/1203] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:32 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28196 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:11:32.250134 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-221f4719-057f-4731-9823-438e854e041c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:32.257854 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-221f4719-057f-4731-9823-438e854e041c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:32.259382 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-221f4719-057f-4731-9823-438e854e041c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:32.260541 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-221f4719-057f-4731-9823-438e854e041c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1723 microversion: 2.20 time: 0.158813 Jan 19 16:11:32.261100 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 569/1204] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:32 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:11:33.196342 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-dcf867c6-7e7c-459e-b48b-de71f0d97722 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:33.197340 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-dcf867c6-7e7c-459e-b48b-de71f0d97722 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:33.204288 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dcf867c6-7e7c-459e-b48b-de71f0d97722 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:33.204733 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dcf867c6-7e7c-459e-b48b-de71f0d97722 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:33.205507 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dcf867c6-7e7c-459e-b48b-de71f0d97722 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:33.205937 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-dcf867c6-7e7c-459e-b48b-de71f0d97722 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:33.279090 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e7a49476-15d7-41c9-acd3-2f07aba2eed8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:33.279666 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-e7a49476-15d7-41c9-acd3-2f07aba2eed8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:33.281286 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-dcf867c6-7e7c-459e-b48b-de71f0d97722 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28487 microversion: 2.1 time: 0.088801 Jan 19 16:11:33.281987 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 636/1205] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:33 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28487 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:33.286810 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e7a49476-15d7-41c9-acd3-2f07aba2eed8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:33.287277 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e7a49476-15d7-41c9-acd3-2f07aba2eed8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:33.288055 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e7a49476-15d7-41c9-acd3-2f07aba2eed8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:33.288548 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e7a49476-15d7-41c9-acd3-2f07aba2eed8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:33.427628 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e7a49476-15d7-41c9-acd3-2f07aba2eed8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:33.436783 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e7a49476-15d7-41c9-acd3-2f07aba2eed8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:33.438331 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e7a49476-15d7-41c9-acd3-2f07aba2eed8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:33.439544 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e7a49476-15d7-41c9-acd3-2f07aba2eed8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1723 microversion: 2.20 time: 0.164323 Jan 19 16:11:33.440108 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 570/1206] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:33 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:11:34.292996 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-6cf40e07-8961-4f08-becf-85e2eb0f3b42 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:34.293981 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-6cf40e07-8961-4f08-becf-85e2eb0f3b42 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:34.300835 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6cf40e07-8961-4f08-becf-85e2eb0f3b42 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:34.301947 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6cf40e07-8961-4f08-becf-85e2eb0f3b42 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:34.302753 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6cf40e07-8961-4f08-becf-85e2eb0f3b42 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:34.303210 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6cf40e07-8961-4f08-becf-85e2eb0f3b42 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:34.366055 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-6cf40e07-8961-4f08-becf-85e2eb0f3b42 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28487 microversion: 2.1 time: 0.076819 Jan 19 16:11:34.366646 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 637/1207] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:34 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28487 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:34.457887 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c2fc93cc-cdc6-49ae-9679-5e5aa02563dd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:34.458515 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c2fc93cc-cdc6-49ae-9679-5e5aa02563dd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:34.464913 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c2fc93cc-cdc6-49ae-9679-5e5aa02563dd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:34.465353 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c2fc93cc-cdc6-49ae-9679-5e5aa02563dd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:34.466136 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c2fc93cc-cdc6-49ae-9679-5e5aa02563dd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:34.466563 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c2fc93cc-cdc6-49ae-9679-5e5aa02563dd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:34.653717 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c2fc93cc-cdc6-49ae-9679-5e5aa02563dd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:34.662353 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c2fc93cc-cdc6-49ae-9679-5e5aa02563dd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:34.663951 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c2fc93cc-cdc6-49ae-9679-5e5aa02563dd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:34.665105 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c2fc93cc-cdc6-49ae-9679-5e5aa02563dd tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1723 microversion: 2.20 time: 0.210921 Jan 19 16:11:34.665750 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 571/1208] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:34 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:11:35.377481 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-662289b9-af43-485c-8cf7-419cbb4df414 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:35.378390 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-662289b9-af43-485c-8cf7-419cbb4df414 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:35.385469 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-662289b9-af43-485c-8cf7-419cbb4df414 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:35.385911 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-662289b9-af43-485c-8cf7-419cbb4df414 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:35.386726 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-662289b9-af43-485c-8cf7-419cbb4df414 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:35.387189 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-662289b9-af43-485c-8cf7-419cbb4df414 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:35.465058 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-662289b9-af43-485c-8cf7-419cbb4df414 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.091556 Jan 19 16:11:35.465700 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 638/1209] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:35 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:35.683477 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e13e7c68-1912-4908-be86-3f5fcec0cb9f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:35.684008 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-e13e7c68-1912-4908-be86-3f5fcec0cb9f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:35.690244 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e13e7c68-1912-4908-be86-3f5fcec0cb9f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:35.690596 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e13e7c68-1912-4908-be86-3f5fcec0cb9f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:35.691389 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e13e7c68-1912-4908-be86-3f5fcec0cb9f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:35.692326 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e13e7c68-1912-4908-be86-3f5fcec0cb9f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:35.823324 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e13e7c68-1912-4908-be86-3f5fcec0cb9f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:35.831318 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e13e7c68-1912-4908-be86-3f5fcec0cb9f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:35.833570 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e13e7c68-1912-4908-be86-3f5fcec0cb9f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:35.834789 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e13e7c68-1912-4908-be86-3f5fcec0cb9f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1723 microversion: 2.20 time: 0.155347 Jan 19 16:11:35.835380 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 572/1210] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:35 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:11:36.477573 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-fc053741-8c22-458e-9216-96928f469f60 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:36.478570 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-fc053741-8c22-458e-9216-96928f469f60 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:36.485513 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fc053741-8c22-458e-9216-96928f469f60 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:36.485958 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fc053741-8c22-458e-9216-96928f469f60 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:36.486736 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fc053741-8c22-458e-9216-96928f469f60 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:36.487193 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fc053741-8c22-458e-9216-96928f469f60 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:36.548055 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-fc053741-8c22-458e-9216-96928f469f60 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.074394 Jan 19 16:11:36.548726 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 639/1211] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:36 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:36.852975 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-772d06c6-0724-48af-91df-8081f2e881b1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:36.853614 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-772d06c6-0724-48af-91df-8081f2e881b1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:36.860250 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-772d06c6-0724-48af-91df-8081f2e881b1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:36.860476 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-772d06c6-0724-48af-91df-8081f2e881b1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:36.861257 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-772d06c6-0724-48af-91df-8081f2e881b1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:36.861727 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-772d06c6-0724-48af-91df-8081f2e881b1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:36.988168 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-772d06c6-0724-48af-91df-8081f2e881b1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:36.996470 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-772d06c6-0724-48af-91df-8081f2e881b1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:36.997978 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-772d06c6-0724-48af-91df-8081f2e881b1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:36.999154 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-772d06c6-0724-48af-91df-8081f2e881b1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1723 microversion: 2.20 time: 0.149948 Jan 19 16:11:36.999712 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 573/1212] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:36 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:11:37.559686 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-81e000af-6522-42df-893a-4390c8c7d4d4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:37.560681 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-81e000af-6522-42df-893a-4390c8c7d4d4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:37.567580 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-81e000af-6522-42df-893a-4390c8c7d4d4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:37.568025 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-81e000af-6522-42df-893a-4390c8c7d4d4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:37.568816 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-81e000af-6522-42df-893a-4390c8c7d4d4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:37.569223 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-81e000af-6522-42df-893a-4390c8c7d4d4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:37.629705 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-81e000af-6522-42df-893a-4390c8c7d4d4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.074171 Jan 19 16:11:37.630363 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 640/1213] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:37 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:38.017920 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-a81a12f0-38ad-4794-9595-fc59d65c40e1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:38.018503 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-a81a12f0-38ad-4794-9595-fc59d65c40e1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:38.025330 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a81a12f0-38ad-4794-9595-fc59d65c40e1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:38.025771 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a81a12f0-38ad-4794-9595-fc59d65c40e1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:38.026539 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a81a12f0-38ad-4794-9595-fc59d65c40e1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:38.026987 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a81a12f0-38ad-4794-9595-fc59d65c40e1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:38.158486 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-a81a12f0-38ad-4794-9595-fc59d65c40e1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:38.166519 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-a81a12f0-38ad-4794-9595-fc59d65c40e1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:38.168029 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-a81a12f0-38ad-4794-9595-fc59d65c40e1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:38.169178 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-a81a12f0-38ad-4794-9595-fc59d65c40e1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1723 microversion: 2.20 time: 0.155102 Jan 19 16:11:38.169732 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 574/1214] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:38 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:11:38.641475 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-9535c9ce-60c5-4cc4-9e59-f3d98064e632 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:38.642766 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-9535c9ce-60c5-4cc4-9e59-f3d98064e632 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:38.649545 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9535c9ce-60c5-4cc4-9e59-f3d98064e632 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:38.649988 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9535c9ce-60c5-4cc4-9e59-f3d98064e632 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:38.650761 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9535c9ce-60c5-4cc4-9e59-f3d98064e632 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:38.651240 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9535c9ce-60c5-4cc4-9e59-f3d98064e632 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:38.711175 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-9535c9ce-60c5-4cc4-9e59-f3d98064e632 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.073546 Jan 19 16:11:38.712099 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 641/1215] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:38 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:39.187310 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-305dcd37-7784-47c7-aca3-7b303dbee6c6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:39.187907 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-305dcd37-7784-47c7-aca3-7b303dbee6c6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:39.194128 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-305dcd37-7784-47c7-aca3-7b303dbee6c6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:39.194592 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-305dcd37-7784-47c7-aca3-7b303dbee6c6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:39.195380 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-305dcd37-7784-47c7-aca3-7b303dbee6c6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:39.195804 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-305dcd37-7784-47c7-aca3-7b303dbee6c6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:39.325196 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-305dcd37-7784-47c7-aca3-7b303dbee6c6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:39.332992 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-305dcd37-7784-47c7-aca3-7b303dbee6c6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:39.334480 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-305dcd37-7784-47c7-aca3-7b303dbee6c6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:39.335659 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-305dcd37-7784-47c7-aca3-7b303dbee6c6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1723 microversion: 2.20 time: 0.152165 Jan 19 16:11:39.336218 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 575/1216] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:39 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:11:39.723638 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-bd118222-dc59-45f5-a191-c95fbf800640 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:39.724622 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-bd118222-dc59-45f5-a191-c95fbf800640 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:39.731524 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bd118222-dc59-45f5-a191-c95fbf800640 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:39.731968 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bd118222-dc59-45f5-a191-c95fbf800640 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:39.732740 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bd118222-dc59-45f5-a191-c95fbf800640 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:39.733170 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bd118222-dc59-45f5-a191-c95fbf800640 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:39.791301 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-bd118222-dc59-45f5-a191-c95fbf800640 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.072055 Jan 19 16:11:39.791958 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 642/1217] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:39 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:40.353495 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-b8c84451-29ca-46cd-803a-cfd62b2e82eb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:40.354130 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-b8c84451-29ca-46cd-803a-cfd62b2e82eb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:40.360469 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b8c84451-29ca-46cd-803a-cfd62b2e82eb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:40.360910 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b8c84451-29ca-46cd-803a-cfd62b2e82eb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:40.361685 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b8c84451-29ca-46cd-803a-cfd62b2e82eb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:40.362111 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b8c84451-29ca-46cd-803a-cfd62b2e82eb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:40.495687 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-b8c84451-29ca-46cd-803a-cfd62b2e82eb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:40.503745 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-b8c84451-29ca-46cd-803a-cfd62b2e82eb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:40.505793 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-b8c84451-29ca-46cd-803a-cfd62b2e82eb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:40.506960 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-b8c84451-29ca-46cd-803a-cfd62b2e82eb tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1723 microversion: 2.20 time: 0.157197 Jan 19 16:11:40.507546 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 576/1218] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:40 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:11:40.803420 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-1268aae0-b271-44df-b33f-2ab61fd7fda2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:40.804410 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-1268aae0-b271-44df-b33f-2ab61fd7fda2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:40.811571 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1268aae0-b271-44df-b33f-2ab61fd7fda2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:40.812013 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1268aae0-b271-44df-b33f-2ab61fd7fda2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:40.812785 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1268aae0-b271-44df-b33f-2ab61fd7fda2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:40.813217 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-1268aae0-b271-44df-b33f-2ab61fd7fda2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:40.872247 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-1268aae0-b271-44df-b33f-2ab61fd7fda2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.072681 Jan 19 16:11:40.873100 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 643/1219] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:40 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:41.525021 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-326db32e-0ddc-488b-b635-08151b8767a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:41.525547 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-326db32e-0ddc-488b-b635-08151b8767a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:41.531857 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-326db32e-0ddc-488b-b635-08151b8767a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:41.532303 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-326db32e-0ddc-488b-b635-08151b8767a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:41.533082 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-326db32e-0ddc-488b-b635-08151b8767a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:41.533514 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-326db32e-0ddc-488b-b635-08151b8767a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:41.664271 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-326db32e-0ddc-488b-b635-08151b8767a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:41.672254 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-326db32e-0ddc-488b-b635-08151b8767a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:41.673762 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-326db32e-0ddc-488b-b635-08151b8767a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:41.674917 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-326db32e-0ddc-488b-b635-08151b8767a8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1723 microversion: 2.20 time: 0.153803 Jan 19 16:11:41.675505 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 577/1220] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:41 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:11:41.884523 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-628ab939-b281-48c7-bd8a-049e94197dcf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:41.885549 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-628ab939-b281-48c7-bd8a-049e94197dcf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:41.892527 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-628ab939-b281-48c7-bd8a-049e94197dcf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:41.892977 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-628ab939-b281-48c7-bd8a-049e94197dcf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:41.893760 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-628ab939-b281-48c7-bd8a-049e94197dcf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:41.894195 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-628ab939-b281-48c7-bd8a-049e94197dcf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:41.954196 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-628ab939-b281-48c7-bd8a-049e94197dcf tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.073592 Jan 19 16:11:41.955070 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 644/1221] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:41 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:42.693099 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f92b5377-8970-424a-85a2-3b48b365ab54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:42.699872 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-f92b5377-8970-424a-85a2-3b48b365ab54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:42.699872 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f92b5377-8970-424a-85a2-3b48b365ab54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:42.700269 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f92b5377-8970-424a-85a2-3b48b365ab54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:42.701037 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f92b5377-8970-424a-85a2-3b48b365ab54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:42.701462 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f92b5377-8970-424a-85a2-3b48b365ab54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:42.829974 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-f92b5377-8970-424a-85a2-3b48b365ab54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:42.838635 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-f92b5377-8970-424a-85a2-3b48b365ab54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:42.841029 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-f92b5377-8970-424a-85a2-3b48b365ab54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:42.842434 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f92b5377-8970-424a-85a2-3b48b365ab54 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1723 microversion: 2.20 time: 0.153035 Jan 19 16:11:42.849434 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 578/1222] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:42 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:11:42.966500 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-332b428a-1209-4d8d-a1d0-459a96344dae tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:42.967551 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-332b428a-1209-4d8d-a1d0-459a96344dae tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:42.975131 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-332b428a-1209-4d8d-a1d0-459a96344dae tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:42.975576 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-332b428a-1209-4d8d-a1d0-459a96344dae tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:42.976334 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-332b428a-1209-4d8d-a1d0-459a96344dae tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:42.976758 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-332b428a-1209-4d8d-a1d0-459a96344dae tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:43.042624 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-332b428a-1209-4d8d-a1d0-459a96344dae tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.080182 Jan 19 16:11:43.043308 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 645/1223] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:42 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:43.861259 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-1ec2ac34-1ed0-4462-b85c-8da0b12302a1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:43.861811 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-1ec2ac34-1ed0-4462-b85c-8da0b12302a1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:43.868620 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1ec2ac34-1ed0-4462-b85c-8da0b12302a1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:43.869059 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1ec2ac34-1ed0-4462-b85c-8da0b12302a1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:43.869834 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1ec2ac34-1ed0-4462-b85c-8da0b12302a1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:43.870260 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1ec2ac34-1ed0-4462-b85c-8da0b12302a1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:44.006031 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-1ec2ac34-1ed0-4462-b85c-8da0b12302a1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:44.014339 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-1ec2ac34-1ed0-4462-b85c-8da0b12302a1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:44.015995 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-1ec2ac34-1ed0-4462-b85c-8da0b12302a1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:44.017164 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-1ec2ac34-1ed0-4462-b85c-8da0b12302a1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1723 microversion: 2.20 time: 0.159807 Jan 19 16:11:44.017731 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 579/1224] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:43 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:11:44.055949 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-2f9fd74f-d1fb-44a6-9477-784b32970594 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:44.056948 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-2f9fd74f-d1fb-44a6-9477-784b32970594 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:44.064014 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2f9fd74f-d1fb-44a6-9477-784b32970594 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:44.064459 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2f9fd74f-d1fb-44a6-9477-784b32970594 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:44.065244 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2f9fd74f-d1fb-44a6-9477-784b32970594 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:44.065676 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2f9fd74f-d1fb-44a6-9477-784b32970594 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:45.035081 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-53a2765f-57a9-4a40-9c04-489177a37849 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:45.035703 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-53a2765f-57a9-4a40-9c04-489177a37849 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:45.042008 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-53a2765f-57a9-4a40-9c04-489177a37849 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:45.042452 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-53a2765f-57a9-4a40-9c04-489177a37849 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:45.043255 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-53a2765f-57a9-4a40-9c04-489177a37849 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:45.043697 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-53a2765f-57a9-4a40-9c04-489177a37849 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:45.174273 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-53a2765f-57a9-4a40-9c04-489177a37849 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:45.182815 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-53a2765f-57a9-4a40-9c04-489177a37849 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:45.184347 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-53a2765f-57a9-4a40-9c04-489177a37849 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:45.185496 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-53a2765f-57a9-4a40-9c04-489177a37849 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1723 microversion: 2.20 time: 0.154303 Jan 19 16:11:45.186050 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 580/1225] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:45 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:11:46.202937 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-55d86854-3fab-4ef1-99f4-0929d39fd99b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:46.203602 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-55d86854-3fab-4ef1-99f4-0929d39fd99b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:46.210394 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-55d86854-3fab-4ef1-99f4-0929d39fd99b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:46.210866 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-55d86854-3fab-4ef1-99f4-0929d39fd99b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:46.211664 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-55d86854-3fab-4ef1-99f4-0929d39fd99b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:46.212092 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-55d86854-3fab-4ef1-99f4-0929d39fd99b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:46.340840 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-55d86854-3fab-4ef1-99f4-0929d39fd99b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:46.348698 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-55d86854-3fab-4ef1-99f4-0929d39fd99b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:46.350195 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-55d86854-3fab-4ef1-99f4-0929d39fd99b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:46.351369 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-55d86854-3fab-4ef1-99f4-0929d39fd99b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1723 microversion: 2.20 time: 0.152297 Jan 19 16:11:46.351925 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 581/1226] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:46 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:11:46.640106 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-2f9fd74f-d1fb-44a6-9477-784b32970594 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 2.589004 Jan 19 16:11:46.640765 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 646/1227] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:44 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 2591 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:47.369675 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d9e6bd7e-6a72-4f67-8f2c-73686456effc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:47.370438 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d9e6bd7e-6a72-4f67-8f2c-73686456effc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:47.376756 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d9e6bd7e-6a72-4f67-8f2c-73686456effc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:47.377190 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d9e6bd7e-6a72-4f67-8f2c-73686456effc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:47.377972 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d9e6bd7e-6a72-4f67-8f2c-73686456effc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:47.378395 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d9e6bd7e-6a72-4f67-8f2c-73686456effc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:47.516378 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d9e6bd7e-6a72-4f67-8f2c-73686456effc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:47.525821 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d9e6bd7e-6a72-4f67-8f2c-73686456effc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:47.527388 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d9e6bd7e-6a72-4f67-8f2c-73686456effc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:47.528557 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d9e6bd7e-6a72-4f67-8f2c-73686456effc tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1723 microversion: 2.20 time: 0.162692 Jan 19 16:11:47.529127 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 582/1228] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:47 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:11:47.652967 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-25dbc3a1-f049-4628-a611-74005da6ce51 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:47.653906 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-25dbc3a1-f049-4628-a611-74005da6ce51 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:47.662246 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-25dbc3a1-f049-4628-a611-74005da6ce51 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:47.662775 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-25dbc3a1-f049-4628-a611-74005da6ce51 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:47.663654 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-25dbc3a1-f049-4628-a611-74005da6ce51 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:47.664144 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-25dbc3a1-f049-4628-a611-74005da6ce51 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:47.725372 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-25dbc3a1-f049-4628-a611-74005da6ce51 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.076512 Jan 19 16:11:47.726056 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 647/1229] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:47 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:48.546798 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-95b5444b-b16a-46d6-a054-eacda8bb9779 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:48.547537 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-95b5444b-b16a-46d6-a054-eacda8bb9779 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:48.554053 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-95b5444b-b16a-46d6-a054-eacda8bb9779 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:48.554488 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-95b5444b-b16a-46d6-a054-eacda8bb9779 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:48.555525 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-95b5444b-b16a-46d6-a054-eacda8bb9779 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:48.555957 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-95b5444b-b16a-46d6-a054-eacda8bb9779 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:48.689913 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-95b5444b-b16a-46d6-a054-eacda8bb9779 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:48.697588 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-95b5444b-b16a-46d6-a054-eacda8bb9779 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:48.699130 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-95b5444b-b16a-46d6-a054-eacda8bb9779 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:48.700480 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-95b5444b-b16a-46d6-a054-eacda8bb9779 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1723 microversion: 2.20 time: 0.157331 Jan 19 16:11:48.700850 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 583/1230] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:48 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:11:48.737154 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d971708f-febc-46a2-add6-84f75c5759e6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:48.738155 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-d971708f-febc-46a2-add6-84f75c5759e6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:48.745814 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d971708f-febc-46a2-add6-84f75c5759e6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:48.746260 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d971708f-febc-46a2-add6-84f75c5759e6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:48.747087 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d971708f-febc-46a2-add6-84f75c5759e6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:48.747523 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d971708f-febc-46a2-add6-84f75c5759e6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:48.807948 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-d971708f-febc-46a2-add6-84f75c5759e6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.074623 Jan 19 16:11:48.811982 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 648/1231] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:48 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:49.718046 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-055fde00-00ad-4275-b704-5bf7ab772e83 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:49.718663 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-055fde00-00ad-4275-b704-5bf7ab772e83 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:49.725758 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-055fde00-00ad-4275-b704-5bf7ab772e83 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:49.726206 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-055fde00-00ad-4275-b704-5bf7ab772e83 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:49.727006 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-055fde00-00ad-4275-b704-5bf7ab772e83 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:49.727442 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-055fde00-00ad-4275-b704-5bf7ab772e83 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:49.820724 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ccabea8f-0417-436c-82bc-bf513c349813 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:49.821731 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ccabea8f-0417-436c-82bc-bf513c349813 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:49.828588 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ccabea8f-0417-436c-82bc-bf513c349813 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:49.855959 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ccabea8f-0417-436c-82bc-bf513c349813 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:49.855959 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ccabea8f-0417-436c-82bc-bf513c349813 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:49.855959 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ccabea8f-0417-436c-82bc-bf513c349813 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:49.860793 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-055fde00-00ad-4275-b704-5bf7ab772e83 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:49.869222 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-055fde00-00ad-4275-b704-5bf7ab772e83 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:49.870707 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-055fde00-00ad-4275-b704-5bf7ab772e83 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:49.871884 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-055fde00-00ad-4275-b704-5bf7ab772e83 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1723 microversion: 2.20 time: 0.157568 Jan 19 16:11:49.872441 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 584/1232] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:49 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:11:50.575313 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ccabea8f-0417-436c-82bc-bf513c349813 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.758976 Jan 19 16:11:50.575997 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 649/1233] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:49 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:11:50.889992 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-b6a6ee6a-42f8-47ec-a992-b44c44bee40f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:50.890538 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-b6a6ee6a-42f8-47ec-a992-b44c44bee40f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:50.897393 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b6a6ee6a-42f8-47ec-a992-b44c44bee40f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:50.897832 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b6a6ee6a-42f8-47ec-a992-b44c44bee40f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:50.898591 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b6a6ee6a-42f8-47ec-a992-b44c44bee40f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:50.899156 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b6a6ee6a-42f8-47ec-a992-b44c44bee40f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:51.028131 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-b6a6ee6a-42f8-47ec-a992-b44c44bee40f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:51.036169 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-b6a6ee6a-42f8-47ec-a992-b44c44bee40f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:51.037657 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-b6a6ee6a-42f8-47ec-a992-b44c44bee40f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:51.038813 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-b6a6ee6a-42f8-47ec-a992-b44c44bee40f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1744 microversion: 2.20 time: 0.152697 Jan 19 16:11:51.039414 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 585/1234] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:50 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:11:51.587576 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-26efd98f-8f4a-43ac-a535-cfb0cf9d1917 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:51.588584 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-26efd98f-8f4a-43ac-a535-cfb0cf9d1917 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:51.596195 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-26efd98f-8f4a-43ac-a535-cfb0cf9d1917 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:51.596642 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-26efd98f-8f4a-43ac-a535-cfb0cf9d1917 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:51.597428 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-26efd98f-8f4a-43ac-a535-cfb0cf9d1917 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:51.597862 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-26efd98f-8f4a-43ac-a535-cfb0cf9d1917 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:51.691535 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-26efd98f-8f4a-43ac-a535-cfb0cf9d1917 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.107828 Jan 19 16:11:51.692124 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 650/1235] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:51 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:52.058109 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-34c20754-bfa4-4729-963c-e952476332b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:52.058706 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-34c20754-bfa4-4729-963c-e952476332b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:52.065111 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-34c20754-bfa4-4729-963c-e952476332b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:52.065555 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-34c20754-bfa4-4729-963c-e952476332b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:52.066335 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-34c20754-bfa4-4729-963c-e952476332b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:52.066766 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-34c20754-bfa4-4729-963c-e952476332b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:52.198398 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-34c20754-bfa4-4729-963c-e952476332b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:52.206569 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-34c20754-bfa4-4729-963c-e952476332b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:52.208179 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-34c20754-bfa4-4729-963c-e952476332b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:52.209995 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-34c20754-bfa4-4729-963c-e952476332b6 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1744 microversion: 2.20 time: 0.155854 Jan 19 16:11:52.210570 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 586/1236] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:52 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:11:52.703862 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-22937367-9085-414d-ba09-3614814d17d6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:52.704776 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-22937367-9085-414d-ba09-3614814d17d6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:52.712209 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-22937367-9085-414d-ba09-3614814d17d6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:52.712651 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-22937367-9085-414d-ba09-3614814d17d6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:52.713423 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-22937367-9085-414d-ba09-3614814d17d6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:52.713857 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-22937367-9085-414d-ba09-3614814d17d6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:52.775579 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-22937367-9085-414d-ba09-3614814d17d6 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.075614 Jan 19 16:11:52.776456 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 651/1237] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:52 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:53.228037 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-06aa4ffc-0e9a-4ed2-a1c8-100cecc58e7b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:53.228646 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-06aa4ffc-0e9a-4ed2-a1c8-100cecc58e7b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:53.235158 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-06aa4ffc-0e9a-4ed2-a1c8-100cecc58e7b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:53.235610 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-06aa4ffc-0e9a-4ed2-a1c8-100cecc58e7b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:53.236398 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-06aa4ffc-0e9a-4ed2-a1c8-100cecc58e7b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:53.236832 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-06aa4ffc-0e9a-4ed2-a1c8-100cecc58e7b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:53.307699 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-e7d2d555-9f79-4eb8-9b56-1025245c4592 req-ac9d52ab-11c8-4cc4-92b5-a03adcdd8ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c1319b6-bda0-474e-bf40-08f9106fa169", "name": "network-vif-plugged", "status": "completed", "tag": "a7371518-3a83-43f3-a73a-17f850f9c369"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:53.309651 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:11:53.309651 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:11:53.317842 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-e7d2d555-9f79-4eb8-9b56-1025245c4592 req-ac9d52ab-11c8-4cc4-92b5-a03adcdd8ad9 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:53.318277 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-e7d2d555-9f79-4eb8-9b56-1025245c4592 req-ac9d52ab-11c8-4cc4-92b5-a03adcdd8ad9 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:53.333281 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-e7d2d555-9f79-4eb8-9b56-1025245c4592 req-ac9d52ab-11c8-4cc4-92b5-a03adcdd8ad9 service nova] Creating event network-vif-plugged:a7371518-3a83-43f3-a73a-17f850f9c369 for instance 9c1319b6-bda0-474e-bf40-08f9106fa169 on hv-cinder-82002 Jan 19 16:11:53.338106 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-e7d2d555-9f79-4eb8-9b56-1025245c4592 req-ac9d52ab-11c8-4cc4-92b5-a03adcdd8ad9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035687 Jan 19 16:11:53.338798 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 652/1238] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:11:53.370884 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-06aa4ffc-0e9a-4ed2-a1c8-100cecc58e7b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:53.378818 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-06aa4ffc-0e9a-4ed2-a1c8-100cecc58e7b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:53.380400 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-06aa4ffc-0e9a-4ed2-a1c8-100cecc58e7b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:53.381661 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-06aa4ffc-0e9a-4ed2-a1c8-100cecc58e7b tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1744 microversion: 2.20 time: 0.157344 Jan 19 16:11:53.382239 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 587/1239] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:53 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:11:53.788166 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-9c096478-bb58-40e9-948c-711a6dfbfcdb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:53.789150 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-9c096478-bb58-40e9-948c-711a6dfbfcdb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:53.795314 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9c096478-bb58-40e9-948c-711a6dfbfcdb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:53.795755 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9c096478-bb58-40e9-948c-711a6dfbfcdb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:53.796520 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9c096478-bb58-40e9-948c-711a6dfbfcdb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:53.796950 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9c096478-bb58-40e9-948c-711a6dfbfcdb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:53.857739 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-9c096478-bb58-40e9-948c-711a6dfbfcdb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.073921 Jan 19 16:11:53.861695 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 653/1240] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:53 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:54.400309 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e591ac63-55a9-403c-b0eb-7580febc28ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:54.400907 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-e591ac63-55a9-403c-b0eb-7580febc28ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:54.407280 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e591ac63-55a9-403c-b0eb-7580febc28ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:54.407724 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e591ac63-55a9-403c-b0eb-7580febc28ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:54.408497 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e591ac63-55a9-403c-b0eb-7580febc28ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:54.408923 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e591ac63-55a9-403c-b0eb-7580febc28ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:54.538391 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e591ac63-55a9-403c-b0eb-7580febc28ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:54.546588 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e591ac63-55a9-403c-b0eb-7580febc28ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:54.548131 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e591ac63-55a9-403c-b0eb-7580febc28ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:54.549279 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e591ac63-55a9-403c-b0eb-7580febc28ba tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1744 microversion: 2.20 time: 0.152794 Jan 19 16:11:54.549837 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 588/1241] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:54 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:11:54.870046 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-6b33f617-6eea-4f5c-99f3-f5a454eb4b7f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:54.871092 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-6b33f617-6eea-4f5c-99f3-f5a454eb4b7f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:54.877873 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6b33f617-6eea-4f5c-99f3-f5a454eb4b7f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:54.878510 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6b33f617-6eea-4f5c-99f3-f5a454eb4b7f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:54.879314 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6b33f617-6eea-4f5c-99f3-f5a454eb4b7f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:54.879744 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6b33f617-6eea-4f5c-99f3-f5a454eb4b7f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:54.954026 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-6b33f617-6eea-4f5c-99f3-f5a454eb4b7f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.087866 Jan 19 16:11:54.954694 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 654/1242] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:54 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:55.568267 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d10e19e4-8555-44ef-8b96-5ed86b80d52d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:55.568863 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d10e19e4-8555-44ef-8b96-5ed86b80d52d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:55.575130 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d10e19e4-8555-44ef-8b96-5ed86b80d52d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:55.575567 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d10e19e4-8555-44ef-8b96-5ed86b80d52d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:55.576332 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d10e19e4-8555-44ef-8b96-5ed86b80d52d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:55.576757 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d10e19e4-8555-44ef-8b96-5ed86b80d52d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:55.714616 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d10e19e4-8555-44ef-8b96-5ed86b80d52d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:55.722412 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d10e19e4-8555-44ef-8b96-5ed86b80d52d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:55.723952 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d10e19e4-8555-44ef-8b96-5ed86b80d52d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:55.725093 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d10e19e4-8555-44ef-8b96-5ed86b80d52d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1744 microversion: 2.20 time: 0.160651 Jan 19 16:11:55.725652 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 589/1243] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:55 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:11:55.966606 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8f8dc51e-0369-49c5-b49d-96e4a1d702e5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:55.967648 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-8f8dc51e-0369-49c5-b49d-96e4a1d702e5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:55.974455 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8f8dc51e-0369-49c5-b49d-96e4a1d702e5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:55.974895 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8f8dc51e-0369-49c5-b49d-96e4a1d702e5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:55.975729 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8f8dc51e-0369-49c5-b49d-96e4a1d702e5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:55.976167 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8f8dc51e-0369-49c5-b49d-96e4a1d702e5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:56.037794 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-8f8dc51e-0369-49c5-b49d-96e4a1d702e5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.075096 Jan 19 16:11:56.038451 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 655/1244] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:55 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:56.121978 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d4681117-2d5b-4767-be3d-db388dc345b8 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-336009372", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1630068289", "security_groups": [{"name": "tempest-secgroup-smoke-364405160"}], "block_device_mapping_v2": [{"uuid": "78db00af-2008-4592-964a-46c4f9365c8b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "59d48545-e392-481c-8443-e9229e177c3f"}]}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:56.229976 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.network.neutron [None req-d4681117-2d5b-4767-be3d-db388dc345b8 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] validate_networks() for [('59d48545-e392-481c-8443-e9229e177c3f', None, None, None, None, None)] {{(pid=128875) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:11:56.600068 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-d4681117-2d5b-4767-be3d-db388dc345b8 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Flavor limits 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:11:56.600637 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-d4681117-2d5b-4767-be3d-db388dc345b8 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Image limits 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:11:56.600969 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-d4681117-2d5b-4767-be3d-db388dc345b8 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Flavor pref 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:11:56.601337 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-d4681117-2d5b-4767-be3d-db388dc345b8 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Image pref 0:0:0 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:11:56.601737 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.virt.hardware [None req-d4681117-2d5b-4767-be3d-db388dc345b8 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:11:56.610881 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d4681117-2d5b-4767-be3d-db388dc345b8 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:56.611356 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d4681117-2d5b-4767-be3d-db388dc345b8 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:56.612166 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d4681117-2d5b-4767-be3d-db388dc345b8 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:56.612612 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d4681117-2d5b-4767-be3d-db388dc345b8 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:56.629855 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-d4681117-2d5b-4767-be3d-db388dc345b8 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Getting quotas for project ee1086833404449a901e9a13cc93c8b5. Resources: {'ram', 'cores', 'instances'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:11:56.634404 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-d4681117-2d5b-4767-be3d-db388dc345b8 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Getting quotas for user 054c8acefa4240469678db612ea73c33 and project ee1086833404449a901e9a13cc93c8b5. Resources: {'ram', 'cores', 'instances'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:11:56.688099 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d4681117-2d5b-4767-be3d-db388dc345b8 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Going to run 1 instances... {{(pid=128875) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:11:56.690300 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d4681117-2d5b-4767-be3d-db388dc345b8 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='78db00af-2008-4592-964a-46c4f9365c8b',volume_size=None,volume_type=None)] {{(pid=128875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:11:56.744129 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-98767ad7-c021-4508-a24b-dc2d0eb27457 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:56.744826 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-98767ad7-c021-4508-a24b-dc2d0eb27457 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:56.751751 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-98767ad7-c021-4508-a24b-dc2d0eb27457 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:56.752197 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-98767ad7-c021-4508-a24b-dc2d0eb27457 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:56.753050 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-98767ad7-c021-4508-a24b-dc2d0eb27457 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:56.753486 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-98767ad7-c021-4508-a24b-dc2d0eb27457 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:56.889891 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-98767ad7-c021-4508-a24b-dc2d0eb27457 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:56.897725 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-98767ad7-c021-4508-a24b-dc2d0eb27457 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:56.899920 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-98767ad7-c021-4508-a24b-dc2d0eb27457 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:56.901057 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-98767ad7-c021-4508-a24b-dc2d0eb27457 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1744 microversion: 2.20 time: 0.161020 Jan 19 16:11:56.901616 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 656/1245] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:56 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:11:57.049962 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-cb9d3ffd-c56d-491a-b4cf-cd3b062b055c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:57.050867 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-cb9d3ffd-c56d-491a-b4cf-cd3b062b055c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:57.057696 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cb9d3ffd-c56d-491a-b4cf-cd3b062b055c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:57.058143 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cb9d3ffd-c56d-491a-b4cf-cd3b062b055c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:57.058914 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cb9d3ffd-c56d-491a-b4cf-cd3b062b055c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:57.059413 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cb9d3ffd-c56d-491a-b4cf-cd3b062b055c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:57.066587 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d4681117-2d5b-4767-be3d-db388dc345b8 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.948227 Jan 19 16:11:57.067517 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 590/1246] 10.222.0.58 () {60 vars in 1146 bytes} [Wed Jan 19 16:11:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:11:57.077472 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-06c954c4-b5c0-4f2e-ab6e-db9b6461b2b6 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:57.078076 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-06c954c4-b5c0-4f2e-ab6e-db9b6461b2b6 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:57.130342 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-cb9d3ffd-c56d-491a-b4cf-cd3b062b055c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.083893 Jan 19 16:11:57.131012 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 657/1247] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:57 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:11:57.134953 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-06c954c4-b5c0-4f2e-ab6e-db9b6461b2b6 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:57.139884 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-06c954c4-b5c0-4f2e-ab6e-db9b6461b2b6 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1094 microversion: 2.1 time: 0.065997 Jan 19 16:11:57.140561 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 591/1248] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:11:57 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:11:57.920880 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5632b3f8-7241-45f7-8d51-42cd820f513e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:57.921575 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5632b3f8-7241-45f7-8d51-42cd820f513e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:57.928470 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5632b3f8-7241-45f7-8d51-42cd820f513e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:57.928913 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5632b3f8-7241-45f7-8d51-42cd820f513e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:57.929724 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5632b3f8-7241-45f7-8d51-42cd820f513e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:57.930190 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5632b3f8-7241-45f7-8d51-42cd820f513e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:58.063459 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5632b3f8-7241-45f7-8d51-42cd820f513e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:58.072132 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5632b3f8-7241-45f7-8d51-42cd820f513e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:58.073624 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5632b3f8-7241-45f7-8d51-42cd820f513e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:58.074821 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5632b3f8-7241-45f7-8d51-42cd820f513e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1744 microversion: 2.20 time: 0.158169 Jan 19 16:11:58.075486 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 658/1249] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:57 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:11:58.141720 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-de181192-816d-49e2-bed5-24c32eaad3a1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:58.142710 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-de181192-816d-49e2-bed5-24c32eaad3a1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:58.150466 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-de181192-816d-49e2-bed5-24c32eaad3a1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:58.150902 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-de181192-816d-49e2-bed5-24c32eaad3a1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:58.151708 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-de181192-816d-49e2-bed5-24c32eaad3a1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:58.152134 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-de181192-816d-49e2-bed5-24c32eaad3a1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:58.157102 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-79a31d74-1530-4d54-b274-48c85e39811e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:58.157737 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-79a31d74-1530-4d54-b274-48c85e39811e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:58.164496 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-79a31d74-1530-4d54-b274-48c85e39811e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:58.165194 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-79a31d74-1530-4d54-b274-48c85e39811e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:58.166004 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-79a31d74-1530-4d54-b274-48c85e39811e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:58.166411 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-79a31d74-1530-4d54-b274-48c85e39811e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:58.224324 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-de181192-816d-49e2-bed5-24c32eaad3a1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.086153 Jan 19 16:11:58.225867 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 592/1250] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:58 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:11:58.237596 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-79a31d74-1530-4d54-b274-48c85e39811e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:58.245069 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-79a31d74-1530-4d54-b274-48c85e39811e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1136 microversion: 2.1 time: 0.092224 Jan 19 16:11:58.246136 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 659/1251] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:11:58 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1136 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:11:59.093496 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ea988a45-4a5e-4738-91ce-04e586f99eda tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:59.094187 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-ea988a45-4a5e-4738-91ce-04e586f99eda tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:59.102624 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ea988a45-4a5e-4738-91ce-04e586f99eda tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:59.103104 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ea988a45-4a5e-4738-91ce-04e586f99eda tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:59.103944 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ea988a45-4a5e-4738-91ce-04e586f99eda tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:59.104383 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ea988a45-4a5e-4738-91ce-04e586f99eda tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:59.249836 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-cd67ee2b-ca38-4bb4-801f-8cc7744d0b76 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:11:59.250814 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-cd67ee2b-ca38-4bb4-801f-8cc7744d0b76 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:59.258502 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cd67ee2b-ca38-4bb4-801f-8cc7744d0b76 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:59.258958 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cd67ee2b-ca38-4bb4-801f-8cc7744d0b76 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:59.259915 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cd67ee2b-ca38-4bb4-801f-8cc7744d0b76 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:59.260386 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cd67ee2b-ca38-4bb4-801f-8cc7744d0b76 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:59.316786 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ea988a45-4a5e-4738-91ce-04e586f99eda tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:59.326633 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ea988a45-4a5e-4738-91ce-04e586f99eda tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:59.328242 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ea988a45-4a5e-4738-91ce-04e586f99eda tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:59.329551 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-ea988a45-4a5e-4738-91ce-04e586f99eda tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1744 microversion: 2.20 time: 0.240641 Jan 19 16:11:59.330109 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 593/1252] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:11:59 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1744 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:11:59.337205 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6da65a5c-eaea-4ccd-abd9-9333dec85114 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:11:59.345673 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-6da65a5c-eaea-4ccd-abd9-9333dec85114 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:11:59.345673 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6da65a5c-eaea-4ccd-abd9-9333dec85114 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:59.345673 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6da65a5c-eaea-4ccd-abd9-9333dec85114 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:59.346606 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-cd67ee2b-ca38-4bb4-801f-8cc7744d0b76 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.099079 Jan 19 16:11:59.346714 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6da65a5c-eaea-4ccd-abd9-9333dec85114 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:11:59.347209 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 660/1253] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:11:59 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:11:59.347506 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6da65a5c-eaea-4ccd-abd9-9333dec85114 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:11:59.448489 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6da65a5c-eaea-4ccd-abd9-9333dec85114 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:11:59.458186 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6da65a5c-eaea-4ccd-abd9-9333dec85114 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1210 microversion: 2.1 time: 0.126321 Jan 19 16:11:59.459520 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 594/1254] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:11:59 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1210 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:12:00.355402 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c93baf35-fa40-4bbd-bb6b-fb9666ba05f1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:00.357738 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f1e478f3-5fc0-44bd-8745-6446548bc001 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:00.358767 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-f1e478f3-5fc0-44bd-8745-6446548bc001 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:00.361645 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c93baf35-fa40-4bbd-bb6b-fb9666ba05f1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:00.376218 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f1e478f3-5fc0-44bd-8745-6446548bc001 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:00.376565 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f1e478f3-5fc0-44bd-8745-6446548bc001 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:00.377423 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f1e478f3-5fc0-44bd-8745-6446548bc001 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:00.378193 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f1e478f3-5fc0-44bd-8745-6446548bc001 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:00.378560 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c93baf35-fa40-4bbd-bb6b-fb9666ba05f1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:00.380126 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c93baf35-fa40-4bbd-bb6b-fb9666ba05f1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:00.383205 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c93baf35-fa40-4bbd-bb6b-fb9666ba05f1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:00.383812 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c93baf35-fa40-4bbd-bb6b-fb9666ba05f1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:00.461406 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f1e478f3-5fc0-44bd-8745-6446548bc001 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.107950 Jan 19 16:12:00.462731 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 595/1255] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:12:00 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:12:00.481388 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-83d4b32f-ca89-49aa-ba60-424ad1a07ffc tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:00.482645 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-83d4b32f-ca89-49aa-ba60-424ad1a07ffc tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:00.494081 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-83d4b32f-ca89-49aa-ba60-424ad1a07ffc tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:00.494081 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-83d4b32f-ca89-49aa-ba60-424ad1a07ffc tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:00.494081 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-83d4b32f-ca89-49aa-ba60-424ad1a07ffc tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:00.494495 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-83d4b32f-ca89-49aa-ba60-424ad1a07ffc tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:00.593904 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c93baf35-fa40-4bbd-bb6b-fb9666ba05f1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:00.615342 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c93baf35-fa40-4bbd-bb6b-fb9666ba05f1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:00.617624 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c93baf35-fa40-4bbd-bb6b-fb9666ba05f1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:00.619405 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c93baf35-fa40-4bbd-bb6b-fb9666ba05f1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1739 microversion: 2.20 time: 0.275075 Jan 19 16:12:00.626061 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 661/1256] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:00 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1739 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:12:00.687126 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-83d4b32f-ca89-49aa-ba60-424ad1a07ffc tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:00.695288 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-83d4b32f-ca89-49aa-ba60-424ad1a07ffc tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1277 microversion: 2.1 time: 0.217886 Jan 19 16:12:00.703786 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 596/1257] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:12:00 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1277 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:12:01.401344 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-d3ec06ed-2e78-4dc0-9cf6-9fed18e43d6c req-99ca8fdd-212c-49ac-87f4-2a8e2856efb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8fc83e4-334a-4135-8e9a-ffa59df1a1d0", "tag": "b2227ef0-87de-42b4-a1ba-9d3a0612b9ac"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:01.404647 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:12:01.404647 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:12:01.426183 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-d3ec06ed-2e78-4dc0-9cf6-9fed18e43d6c req-99ca8fdd-212c-49ac-87f4-2a8e2856efb0 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:01.426183 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-d3ec06ed-2e78-4dc0-9cf6-9fed18e43d6c req-99ca8fdd-212c-49ac-87f4-2a8e2856efb0 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:01.438903 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-d3ec06ed-2e78-4dc0-9cf6-9fed18e43d6c req-99ca8fdd-212c-49ac-87f4-2a8e2856efb0 service nova] Creating event network-changed:b2227ef0-87de-42b4-a1ba-9d3a0612b9ac for instance f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 on hv-cinder-82002 Jan 19 16:12:01.452333 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-d3ec06ed-2e78-4dc0-9cf6-9fed18e43d6c req-99ca8fdd-212c-49ac-87f4-2a8e2856efb0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064533 Jan 19 16:12:01.452333 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 662/1258] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:12:01.478554 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-a091aece-35f9-4664-bc8a-25fff16d0b2d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:01.480254 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-a091aece-35f9-4664-bc8a-25fff16d0b2d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:01.492297 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a091aece-35f9-4664-bc8a-25fff16d0b2d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:01.508607 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a091aece-35f9-4664-bc8a-25fff16d0b2d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:01.513533 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a091aece-35f9-4664-bc8a-25fff16d0b2d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:01.513533 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a091aece-35f9-4664-bc8a-25fff16d0b2d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:01.619923 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-a091aece-35f9-4664-bc8a-25fff16d0b2d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.150117 Jan 19 16:12:01.621359 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 597/1259] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:12:01 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:12:01.639650 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-da60f519-978e-439c-a8f0-b424969eb274 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:01.640545 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-da60f519-978e-439c-a8f0-b424969eb274 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:01.652747 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-da60f519-978e-439c-a8f0-b424969eb274 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:01.653815 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-da60f519-978e-439c-a8f0-b424969eb274 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:01.656454 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-da60f519-978e-439c-a8f0-b424969eb274 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:01.660003 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-da60f519-978e-439c-a8f0-b424969eb274 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:01.713994 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f005b291-c01b-417f-a06e-3d2c8a6ef977 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:01.714696 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-f005b291-c01b-417f-a06e-3d2c8a6ef977 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:01.729607 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f005b291-c01b-417f-a06e-3d2c8a6ef977 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:01.730544 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f005b291-c01b-417f-a06e-3d2c8a6ef977 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:01.733234 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f005b291-c01b-417f-a06e-3d2c8a6ef977 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:01.733919 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f005b291-c01b-417f-a06e-3d2c8a6ef977 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:01.881082 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-da60f519-978e-439c-a8f0-b424969eb274 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:01.894021 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-da60f519-978e-439c-a8f0-b424969eb274 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:01.895656 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-da60f519-978e-439c-a8f0-b424969eb274 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:01.896850 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-da60f519-978e-439c-a8f0-b424969eb274 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1739 microversion: 2.20 time: 0.261919 Jan 19 16:12:01.897381 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 663/1260] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:01 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:12:01.988930 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-f005b291-c01b-417f-a06e-3d2c8a6ef977 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:02.001821 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f005b291-c01b-417f-a06e-3d2c8a6ef977 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1265 microversion: 2.1 time: 0.289868 Jan 19 16:12:02.002947 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 598/1261] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:12:01 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1265 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:12:02.631513 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b89353ce-1a3e-4e48-bf12-cff975a36767 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:02.633646 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b89353ce-1a3e-4e48-bf12-cff975a36767 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:02.640102 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b89353ce-1a3e-4e48-bf12-cff975a36767 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:02.640832 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b89353ce-1a3e-4e48-bf12-cff975a36767 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:02.641888 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b89353ce-1a3e-4e48-bf12-cff975a36767 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:02.642540 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b89353ce-1a3e-4e48-bf12-cff975a36767 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:02.820221 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b89353ce-1a3e-4e48-bf12-cff975a36767 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.192128 Jan 19 16:12:02.821358 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 664/1262] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:12:02 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:12:02.915899 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-4a266cab-725f-4c8c-a8f2-5b7beebf12b5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:02.916742 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-4a266cab-725f-4c8c-a8f2-5b7beebf12b5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:02.925434 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4a266cab-725f-4c8c-a8f2-5b7beebf12b5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:02.926209 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4a266cab-725f-4c8c-a8f2-5b7beebf12b5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:02.927269 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4a266cab-725f-4c8c-a8f2-5b7beebf12b5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:02.927878 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4a266cab-725f-4c8c-a8f2-5b7beebf12b5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:03.022658 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-97834e16-c63b-4a73-9b6e-5600c5e754fb tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:03.023399 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-97834e16-c63b-4a73-9b6e-5600c5e754fb tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:03.033415 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-97834e16-c63b-4a73-9b6e-5600c5e754fb tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:03.034171 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-97834e16-c63b-4a73-9b6e-5600c5e754fb tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:03.035280 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-97834e16-c63b-4a73-9b6e-5600c5e754fb tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:03.035731 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-97834e16-c63b-4a73-9b6e-5600c5e754fb tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:03.080287 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-4a266cab-725f-4c8c-a8f2-5b7beebf12b5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:03.089226 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-4a266cab-725f-4c8c-a8f2-5b7beebf12b5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:03.090738 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-4a266cab-725f-4c8c-a8f2-5b7beebf12b5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:03.092422 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-4a266cab-725f-4c8c-a8f2-5b7beebf12b5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1739 microversion: 2.20 time: 0.180344 Jan 19 16:12:03.093005 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 599/1263] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:02 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:12:03.187909 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-97834e16-c63b-4a73-9b6e-5600c5e754fb tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:03.196308 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-97834e16-c63b-4a73-9b6e-5600c5e754fb tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1265 microversion: 2.1 time: 0.178981 Jan 19 16:12:03.197105 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 665/1264] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:12:03 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:12:03.832134 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-4e155826-ed52-4e72-bf9e-d81c73b77ccd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:03.833094 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-4e155826-ed52-4e72-bf9e-d81c73b77ccd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:03.839879 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4e155826-ed52-4e72-bf9e-d81c73b77ccd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:03.840313 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4e155826-ed52-4e72-bf9e-d81c73b77ccd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:03.841078 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4e155826-ed52-4e72-bf9e-d81c73b77ccd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:03.841504 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4e155826-ed52-4e72-bf9e-d81c73b77ccd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:03.906005 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-4e155826-ed52-4e72-bf9e-d81c73b77ccd tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.077356 Jan 19 16:12:03.906846 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 600/1265] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:12:03 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:12:04.113156 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3c3c38bc-cede-4eb3-a844-675ce787fdaa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:04.113763 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3c3c38bc-cede-4eb3-a844-675ce787fdaa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:04.122591 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3c3c38bc-cede-4eb3-a844-675ce787fdaa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:04.123073 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3c3c38bc-cede-4eb3-a844-675ce787fdaa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:04.123874 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3c3c38bc-cede-4eb3-a844-675ce787fdaa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:04.124309 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3c3c38bc-cede-4eb3-a844-675ce787fdaa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:04.217032 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-8842dc4c-28ac-43db-86db-21d396c7126a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:04.218046 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8842dc4c-28ac-43db-86db-21d396c7126a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:04.225105 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8842dc4c-28ac-43db-86db-21d396c7126a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:04.225551 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8842dc4c-28ac-43db-86db-21d396c7126a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:04.226606 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8842dc4c-28ac-43db-86db-21d396c7126a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:04.227261 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8842dc4c-28ac-43db-86db-21d396c7126a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:04.289786 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-3c3c38bc-cede-4eb3-a844-675ce787fdaa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:04.299127 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-3c3c38bc-cede-4eb3-a844-675ce787fdaa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:04.302295 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-3c3c38bc-cede-4eb3-a844-675ce787fdaa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:04.305818 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3c3c38bc-cede-4eb3-a844-675ce787fdaa tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1739 microversion: 2.20 time: 0.195592 Jan 19 16:12:04.307494 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 666/1266] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:04 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:12:04.399260 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8842dc4c-28ac-43db-86db-21d396c7126a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:04.409047 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-8842dc4c-28ac-43db-86db-21d396c7126a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1265 microversion: 2.1 time: 0.196926 Jan 19 16:12:04.409618 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 601/1267] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:12:04 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:12:04.918461 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-13a9c221-cf8d-47bf-9626-698cc441e8b4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:04.919480 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-13a9c221-cf8d-47bf-9626-698cc441e8b4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:04.926129 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-13a9c221-cf8d-47bf-9626-698cc441e8b4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:04.926586 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-13a9c221-cf8d-47bf-9626-698cc441e8b4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:04.927428 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-13a9c221-cf8d-47bf-9626-698cc441e8b4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:04.927851 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-13a9c221-cf8d-47bf-9626-698cc441e8b4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:04.998393 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-13a9c221-cf8d-47bf-9626-698cc441e8b4 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.083094 Jan 19 16:12:05.002939 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 667/1268] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:12:04 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:12:05.325532 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-72bae914-15bc-4569-92f6-eed6fe1139b2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:05.326779 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-72bae914-15bc-4569-92f6-eed6fe1139b2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:05.333208 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-72bae914-15bc-4569-92f6-eed6fe1139b2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:05.333651 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-72bae914-15bc-4569-92f6-eed6fe1139b2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:05.334437 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-72bae914-15bc-4569-92f6-eed6fe1139b2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:05.334869 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-72bae914-15bc-4569-92f6-eed6fe1139b2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:05.425790 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-fd5a27bc-c20f-4df6-907c-db52d5480829 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:05.426472 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-fd5a27bc-c20f-4df6-907c-db52d5480829 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:05.435352 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fd5a27bc-c20f-4df6-907c-db52d5480829 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:05.435664 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fd5a27bc-c20f-4df6-907c-db52d5480829 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:05.437096 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fd5a27bc-c20f-4df6-907c-db52d5480829 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:05.437567 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fd5a27bc-c20f-4df6-907c-db52d5480829 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:05.479464 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-72bae914-15bc-4569-92f6-eed6fe1139b2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:05.488003 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-72bae914-15bc-4569-92f6-eed6fe1139b2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:05.489528 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-72bae914-15bc-4569-92f6-eed6fe1139b2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:05.490729 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-72bae914-15bc-4569-92f6-eed6fe1139b2 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1739 microversion: 2.20 time: 0.169004 Jan 19 16:12:05.501418 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 602/1269] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:05 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:12:05.589412 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-fd5a27bc-c20f-4df6-907c-db52d5480829 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:05.597399 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-fd5a27bc-c20f-4df6-907c-db52d5480829 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1265 microversion: 2.1 time: 0.175666 Jan 19 16:12:05.597975 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 668/1270] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:12:05 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:12:06.011320 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-a24b9f32-7fc6-4e20-abc3-b309a9808fe2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:06.012338 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-a24b9f32-7fc6-4e20-abc3-b309a9808fe2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:06.018961 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a24b9f32-7fc6-4e20-abc3-b309a9808fe2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:06.019441 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a24b9f32-7fc6-4e20-abc3-b309a9808fe2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:06.020305 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a24b9f32-7fc6-4e20-abc3-b309a9808fe2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:06.020745 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a24b9f32-7fc6-4e20-abc3-b309a9808fe2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:06.082890 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-a24b9f32-7fc6-4e20-abc3-b309a9808fe2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.075793 Jan 19 16:12:06.084642 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 603/1271] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:12:06 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:12:06.508592 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d76f17e9-ad25-4611-983a-4d1f14855ade tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:06.509356 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-d76f17e9-ad25-4611-983a-4d1f14855ade tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:06.523167 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d76f17e9-ad25-4611-983a-4d1f14855ade tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:06.523766 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d76f17e9-ad25-4611-983a-4d1f14855ade tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:06.524680 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d76f17e9-ad25-4611-983a-4d1f14855ade tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:06.525357 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d76f17e9-ad25-4611-983a-4d1f14855ade tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:06.613987 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-7bfaac7d-e2da-439d-a9aa-5765b4d7a377 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:06.614685 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-7bfaac7d-e2da-439d-a9aa-5765b4d7a377 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:06.622187 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7bfaac7d-e2da-439d-a9aa-5765b4d7a377 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:06.622885 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7bfaac7d-e2da-439d-a9aa-5765b4d7a377 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:06.623877 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7bfaac7d-e2da-439d-a9aa-5765b4d7a377 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:06.624313 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7bfaac7d-e2da-439d-a9aa-5765b4d7a377 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:06.695264 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-d76f17e9-ad25-4611-983a-4d1f14855ade tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:06.711023 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-d76f17e9-ad25-4611-983a-4d1f14855ade tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:06.712496 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-d76f17e9-ad25-4611-983a-4d1f14855ade tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:06.717618 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-d76f17e9-ad25-4611-983a-4d1f14855ade tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1739 microversion: 2.20 time: 0.212754 Jan 19 16:12:06.729569 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 669/1272] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:06 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:12:06.791358 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-7bfaac7d-e2da-439d-a9aa-5765b4d7a377 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:06.799560 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-7bfaac7d-e2da-439d-a9aa-5765b4d7a377 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1265 microversion: 2.1 time: 0.189524 Jan 19 16:12:06.800570 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 604/1273] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:12:06 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:12:07.096759 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-aca0b8c6-5c83-40f6-ae3e-ae87ac76f3be tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:07.097632 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-aca0b8c6-5c83-40f6-ae3e-ae87ac76f3be tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:07.104499 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-aca0b8c6-5c83-40f6-ae3e-ae87ac76f3be tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:07.104942 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-aca0b8c6-5c83-40f6-ae3e-ae87ac76f3be tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:07.105746 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-aca0b8c6-5c83-40f6-ae3e-ae87ac76f3be tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:07.106175 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-aca0b8c6-5c83-40f6-ae3e-ae87ac76f3be tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:07.168420 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-aca0b8c6-5c83-40f6-ae3e-ae87ac76f3be tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.076741 Jan 19 16:12:07.169079 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 670/1274] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:12:07 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:12:07.736796 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6db3f04b-d0ee-403a-9b9e-387ff932b976 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:07.737337 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-6db3f04b-d0ee-403a-9b9e-387ff932b976 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:07.744408 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6db3f04b-d0ee-403a-9b9e-387ff932b976 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:07.744847 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6db3f04b-d0ee-403a-9b9e-387ff932b976 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:07.745627 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6db3f04b-d0ee-403a-9b9e-387ff932b976 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:07.746056 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6db3f04b-d0ee-403a-9b9e-387ff932b976 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:07.818623 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-05919606-f19f-478f-8296-672cf0fa7796 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:07.819964 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-05919606-f19f-478f-8296-672cf0fa7796 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:07.827180 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-05919606-f19f-478f-8296-672cf0fa7796 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:07.829584 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-05919606-f19f-478f-8296-672cf0fa7796 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:07.829584 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-05919606-f19f-478f-8296-672cf0fa7796 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:07.829584 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-05919606-f19f-478f-8296-672cf0fa7796 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:07.917098 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6db3f04b-d0ee-403a-9b9e-387ff932b976 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:07.926879 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6db3f04b-d0ee-403a-9b9e-387ff932b976 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:07.928655 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-6db3f04b-d0ee-403a-9b9e-387ff932b976 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:07.930662 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6db3f04b-d0ee-403a-9b9e-387ff932b976 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1739 microversion: 2.20 time: 0.197660 Jan 19 16:12:07.934003 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 605/1275] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:07 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:12:07.997028 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-05919606-f19f-478f-8296-672cf0fa7796 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:08.007912 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-05919606-f19f-478f-8296-672cf0fa7796 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1265 microversion: 2.1 time: 0.194001 Jan 19 16:12:08.009296 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 671/1276] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:12:07 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:12:08.180976 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ca8cb986-9c49-4b63-9a90-0fdfe33fbfa1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:08.182118 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-ca8cb986-9c49-4b63-9a90-0fdfe33fbfa1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:08.188269 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ca8cb986-9c49-4b63-9a90-0fdfe33fbfa1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:08.188792 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ca8cb986-9c49-4b63-9a90-0fdfe33fbfa1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:08.189671 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ca8cb986-9c49-4b63-9a90-0fdfe33fbfa1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:08.191897 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ca8cb986-9c49-4b63-9a90-0fdfe33fbfa1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:08.260034 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-ca8cb986-9c49-4b63-9a90-0fdfe33fbfa1 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.083296 Jan 19 16:12:08.261003 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 606/1277] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:12:08 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:12:08.952358 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3cced58d-f9bf-4b02-b954-a851fef2602e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:08.953644 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3cced58d-f9bf-4b02-b954-a851fef2602e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:08.960970 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3cced58d-f9bf-4b02-b954-a851fef2602e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:08.961569 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3cced58d-f9bf-4b02-b954-a851fef2602e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:08.962512 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3cced58d-f9bf-4b02-b954-a851fef2602e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:08.962959 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3cced58d-f9bf-4b02-b954-a851fef2602e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:09.025847 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-80277825-f03c-4809-869d-1f4ea06f3f5c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:09.027521 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-80277825-f03c-4809-869d-1f4ea06f3f5c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:09.035560 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-80277825-f03c-4809-869d-1f4ea06f3f5c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:09.036500 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-80277825-f03c-4809-869d-1f4ea06f3f5c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:09.037801 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-80277825-f03c-4809-869d-1f4ea06f3f5c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:09.038708 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-80277825-f03c-4809-869d-1f4ea06f3f5c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:09.137246 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-3cced58d-f9bf-4b02-b954-a851fef2602e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:09.150286 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-3cced58d-f9bf-4b02-b954-a851fef2602e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:09.154005 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-3cced58d-f9bf-4b02-b954-a851fef2602e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:09.157066 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3cced58d-f9bf-4b02-b954-a851fef2602e tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1739 microversion: 2.20 time: 0.208899 Jan 19 16:12:09.158290 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 672/1278] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:08 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:12:09.229135 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-80277825-f03c-4809-869d-1f4ea06f3f5c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:09.237549 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-80277825-f03c-4809-869d-1f4ea06f3f5c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1265 microversion: 2.1 time: 0.215835 Jan 19 16:12:09.238324 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 607/1279] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:12:09 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:12:09.271601 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-870f5768-2741-441d-87f5-2cf32e3430f9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:09.272912 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-870f5768-2741-441d-87f5-2cf32e3430f9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:09.279117 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-870f5768-2741-441d-87f5-2cf32e3430f9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:09.279463 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-870f5768-2741-441d-87f5-2cf32e3430f9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:09.280253 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-870f5768-2741-441d-87f5-2cf32e3430f9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:09.280690 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-870f5768-2741-441d-87f5-2cf32e3430f9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:09.355352 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-870f5768-2741-441d-87f5-2cf32e3430f9 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.087206 Jan 19 16:12:09.359489 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 673/1280] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:12:09 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:12:10.185644 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-77eb774f-8d1f-4fe7-bc24-c048f84e2344 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:10.186260 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-77eb774f-8d1f-4fe7-bc24-c048f84e2344 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:10.192620 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-77eb774f-8d1f-4fe7-bc24-c048f84e2344 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:10.193068 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-77eb774f-8d1f-4fe7-bc24-c048f84e2344 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:10.193852 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-77eb774f-8d1f-4fe7-bc24-c048f84e2344 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:10.194799 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-77eb774f-8d1f-4fe7-bc24-c048f84e2344 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:10.255469 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-db4ba32d-7901-448b-a2f1-17d07a360d81 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:10.256177 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-db4ba32d-7901-448b-a2f1-17d07a360d81 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:10.263756 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-db4ba32d-7901-448b-a2f1-17d07a360d81 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:10.264210 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-db4ba32d-7901-448b-a2f1-17d07a360d81 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:10.265011 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-db4ba32d-7901-448b-a2f1-17d07a360d81 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:10.265438 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-db4ba32d-7901-448b-a2f1-17d07a360d81 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:10.337500 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-77eb774f-8d1f-4fe7-bc24-c048f84e2344 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:10.350121 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-77eb774f-8d1f-4fe7-bc24-c048f84e2344 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:10.351855 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-77eb774f-8d1f-4fe7-bc24-c048f84e2344 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:10.353130 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-77eb774f-8d1f-4fe7-bc24-c048f84e2344 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1739 microversion: 2.20 time: 0.171300 Jan 19 16:12:10.354190 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 608/1281] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:10 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:12:10.373183 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-3920120c-a830-4041-830e-5df4ff311824 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:10.374168 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-3920120c-a830-4041-830e-5df4ff311824 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:10.380838 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3920120c-a830-4041-830e-5df4ff311824 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:10.381363 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3920120c-a830-4041-830e-5df4ff311824 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:10.382790 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3920120c-a830-4041-830e-5df4ff311824 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:10.383322 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3920120c-a830-4041-830e-5df4ff311824 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:10.437684 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-db4ba32d-7901-448b-a2f1-17d07a360d81 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:10.448126 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-db4ba32d-7901-448b-a2f1-17d07a360d81 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1265 microversion: 2.1 time: 0.196836 Jan 19 16:12:10.448674 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 674/1282] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:12:10 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:12:10.456609 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-3920120c-a830-4041-830e-5df4ff311824 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.087250 Jan 19 16:12:10.457832 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 609/1283] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:12:10 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:12:11.371617 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b092c125-3e39-4d1a-9bc6-8bfbca4454d7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:11.372374 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b092c125-3e39-4d1a-9bc6-8bfbca4454d7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:11.378622 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b092c125-3e39-4d1a-9bc6-8bfbca4454d7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:11.379094 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b092c125-3e39-4d1a-9bc6-8bfbca4454d7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:11.379885 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b092c125-3e39-4d1a-9bc6-8bfbca4454d7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:11.380317 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b092c125-3e39-4d1a-9bc6-8bfbca4454d7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:11.477604 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-b316b260-c557-431b-9a14-fe0a40819b47 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:11.477604 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-b316b260-c557-431b-9a14-fe0a40819b47 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:11.488860 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b316b260-c557-431b-9a14-fe0a40819b47 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:11.489715 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b316b260-c557-431b-9a14-fe0a40819b47 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:11.490814 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b316b260-c557-431b-9a14-fe0a40819b47 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:11.491459 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-b316b260-c557-431b-9a14-fe0a40819b47 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:11.529508 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-b092c125-3e39-4d1a-9bc6-8bfbca4454d7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:11.538648 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-b092c125-3e39-4d1a-9bc6-8bfbca4454d7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:11.540392 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-b092c125-3e39-4d1a-9bc6-8bfbca4454d7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:11.541754 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b092c125-3e39-4d1a-9bc6-8bfbca4454d7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1739 microversion: 2.20 time: 0.174135 Jan 19 16:12:11.542544 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 675/1284] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:11 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:12:11.547363 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-0913f262-f23a-454c-8276-717f8075f85d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:11.548494 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-0913f262-f23a-454c-8276-717f8075f85d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:11.555706 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0913f262-f23a-454c-8276-717f8075f85d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:11.556225 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0913f262-f23a-454c-8276-717f8075f85d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:11.557082 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0913f262-f23a-454c-8276-717f8075f85d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:11.557585 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-0913f262-f23a-454c-8276-717f8075f85d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:11.635671 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-b316b260-c557-431b-9a14-fe0a40819b47 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:11.642910 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-b316b260-c557-431b-9a14-fe0a40819b47 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1265 microversion: 2.1 time: 0.179839 Jan 19 16:12:11.644299 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 610/1285] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:12:11 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:12:11.855023 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-0913f262-f23a-454c-8276-717f8075f85d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.310874 Jan 19 16:12:11.855671 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 676/1286] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:12:11 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:12:12.560519 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-84f046ed-cccd-49cc-bf3a-557896e4b543 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:12.561125 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-84f046ed-cccd-49cc-bf3a-557896e4b543 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:12.567650 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-84f046ed-cccd-49cc-bf3a-557896e4b543 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:12.568108 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-84f046ed-cccd-49cc-bf3a-557896e4b543 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:12.568923 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-84f046ed-cccd-49cc-bf3a-557896e4b543 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:12.569359 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-84f046ed-cccd-49cc-bf3a-557896e4b543 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:12.660963 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-2a9861bc-6b02-4523-ba83-b164a89ef31c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:12.661968 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-2a9861bc-6b02-4523-ba83-b164a89ef31c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:12.669400 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2a9861bc-6b02-4523-ba83-b164a89ef31c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:12.669840 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2a9861bc-6b02-4523-ba83-b164a89ef31c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:12.670622 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2a9861bc-6b02-4523-ba83-b164a89ef31c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:12.671080 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2a9861bc-6b02-4523-ba83-b164a89ef31c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:12.781744 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-84f046ed-cccd-49cc-bf3a-557896e4b543 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:12.790678 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-84f046ed-cccd-49cc-bf3a-557896e4b543 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:12.793533 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-84f046ed-cccd-49cc-bf3a-557896e4b543 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:12.794997 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-84f046ed-cccd-49cc-bf3a-557896e4b543 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1721 microversion: 2.20 time: 0.238185 Jan 19 16:12:12.806016 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 611/1287] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:12 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:12:12.811619 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-2a9861bc-6b02-4523-ba83-b164a89ef31c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:12.823043 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-2a9861bc-6b02-4523-ba83-b164a89ef31c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1265 microversion: 2.1 time: 0.162275 Jan 19 16:12:12.823043 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 677/1288] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:12:12 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:12:12.865602 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-82a6f356-ed39-47c0-8a1c-0fdf65a54222 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:12.866516 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-82a6f356-ed39-47c0-8a1c-0fdf65a54222 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:12.872718 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-82a6f356-ed39-47c0-8a1c-0fdf65a54222 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:12.873155 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-82a6f356-ed39-47c0-8a1c-0fdf65a54222 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:12.873977 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-82a6f356-ed39-47c0-8a1c-0fdf65a54222 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:12.874347 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-82a6f356-ed39-47c0-8a1c-0fdf65a54222 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:13.073729 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-82a6f356-ed39-47c0-8a1c-0fdf65a54222 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.211685 Jan 19 16:12:13.074631 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 612/1289] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:12:12 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:12:13.475977 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-002d12d4-5ae3-4ee0-824c-56d7b66b36b7 req-fca2c154-894e-4ce4-bc26-b83bd3e25dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8fc83e4-334a-4135-8e9a-ffa59df1a1d0", "name": "network-vif-plugged", "status": "completed", "tag": "b2227ef0-87de-42b4-a1ba-9d3a0612b9ac"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:13.477442 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:12:13.477442 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:12:13.484691 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-002d12d4-5ae3-4ee0-824c-56d7b66b36b7 req-fca2c154-894e-4ce4-bc26-b83bd3e25dd4 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:13.485130 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-002d12d4-5ae3-4ee0-824c-56d7b66b36b7 req-fca2c154-894e-4ce4-bc26-b83bd3e25dd4 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:13.496603 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-002d12d4-5ae3-4ee0-824c-56d7b66b36b7 req-fca2c154-894e-4ce4-bc26-b83bd3e25dd4 service nova] Creating event network-vif-plugged:b2227ef0-87de-42b4-a1ba-9d3a0612b9ac for instance f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 on hv-cinder-82002 Jan 19 16:12:13.501891 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-002d12d4-5ae3-4ee0-824c-56d7b66b36b7 req-fca2c154-894e-4ce4-bc26-b83bd3e25dd4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029769 Jan 19 16:12:13.502470 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 678/1290] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:12:13.816284 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-3f0153b0-50b0-4a70-a12a-d34de681767d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:13.816904 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-3f0153b0-50b0-4a70-a12a-d34de681767d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:13.824648 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3f0153b0-50b0-4a70-a12a-d34de681767d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:13.825092 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3f0153b0-50b0-4a70-a12a-d34de681767d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:13.825888 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3f0153b0-50b0-4a70-a12a-d34de681767d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:13.826324 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3f0153b0-50b0-4a70-a12a-d34de681767d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:13.836802 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3b27060d-129f-42a7-b384-3bc8522726c9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:13.837493 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3b27060d-129f-42a7-b384-3bc8522726c9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:13.844230 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3b27060d-129f-42a7-b384-3bc8522726c9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:13.844995 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3b27060d-129f-42a7-b384-3bc8522726c9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:13.845855 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3b27060d-129f-42a7-b384-3bc8522726c9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:13.846299 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3b27060d-129f-42a7-b384-3bc8522726c9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:13.981624 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-3b27060d-129f-42a7-b384-3bc8522726c9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:13.988894 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3b27060d-129f-42a7-b384-3bc8522726c9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1265 microversion: 2.1 time: 0.156593 Jan 19 16:12:13.989460 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 679/1291] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:12:13 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:12:14.007688 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-3f0153b0-50b0-4a70-a12a-d34de681767d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:14.016237 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-3f0153b0-50b0-4a70-a12a-d34de681767d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:14.017736 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-3f0153b0-50b0-4a70-a12a-d34de681767d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:14.018875 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-3f0153b0-50b0-4a70-a12a-d34de681767d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1721 microversion: 2.20 time: 0.206963 Jan 19 16:12:14.019464 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 613/1292] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:13 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:12:14.084188 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-21c8015b-328c-46f9-8999-66860f4cfd05 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:14.085040 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-21c8015b-328c-46f9-8999-66860f4cfd05 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:14.090879 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-21c8015b-328c-46f9-8999-66860f4cfd05 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:14.091395 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-21c8015b-328c-46f9-8999-66860f4cfd05 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:14.092161 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-21c8015b-328c-46f9-8999-66860f4cfd05 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:14.092588 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-21c8015b-328c-46f9-8999-66860f4cfd05 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:14.399703 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-21c8015b-328c-46f9-8999-66860f4cfd05 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 28655 microversion: 2.1 time: 0.318903 Jan 19 16:12:14.400306 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 680/1293] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:12:14 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 28655 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:12:15.006194 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-816f77ec-ecbc-4b46-8df9-6a3040afa9b1 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:15.007417 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-816f77ec-ecbc-4b46-8df9-6a3040afa9b1 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:15.013851 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-816f77ec-ecbc-4b46-8df9-6a3040afa9b1 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:15.014296 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-816f77ec-ecbc-4b46-8df9-6a3040afa9b1 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:15.015095 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-816f77ec-ecbc-4b46-8df9-6a3040afa9b1 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:15.015533 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-816f77ec-ecbc-4b46-8df9-6a3040afa9b1 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:15.036974 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ae368328-797c-41e1-9c42-b440ae1be5e0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:15.037667 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ae368328-797c-41e1-9c42-b440ae1be5e0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:15.044399 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ae368328-797c-41e1-9c42-b440ae1be5e0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:15.044835 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ae368328-797c-41e1-9c42-b440ae1be5e0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:15.045613 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ae368328-797c-41e1-9c42-b440ae1be5e0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:15.046041 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ae368328-797c-41e1-9c42-b440ae1be5e0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:15.151061 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-816f77ec-ecbc-4b46-8df9-6a3040afa9b1 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:15.158763 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-816f77ec-ecbc-4b46-8df9-6a3040afa9b1 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1265 microversion: 2.1 time: 0.156181 Jan 19 16:12:15.159378 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 614/1294] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:12:15 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:12:15.187111 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ae368328-797c-41e1-9c42-b440ae1be5e0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:15.195526 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ae368328-797c-41e1-9c42-b440ae1be5e0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:15.197029 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ae368328-797c-41e1-9c42-b440ae1be5e0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:15.198178 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ae368328-797c-41e1-9c42-b440ae1be5e0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1721 microversion: 2.20 time: 0.165259 Jan 19 16:12:15.198737 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 681/1295] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:15 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:12:15.411529 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-6456f4a7-e2b8-4e95-a5dc-b0a8b39dd3c0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:15.412431 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-6456f4a7-e2b8-4e95-a5dc-b0a8b39dd3c0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:15.419286 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6456f4a7-e2b8-4e95-a5dc-b0a8b39dd3c0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:15.419803 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6456f4a7-e2b8-4e95-a5dc-b0a8b39dd3c0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:15.420676 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6456f4a7-e2b8-4e95-a5dc-b0a8b39dd3c0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:15.421253 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-6456f4a7-e2b8-4e95-a5dc-b0a8b39dd3c0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:15.511193 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-6456f4a7-e2b8-4e95-a5dc-b0a8b39dd3c0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 29954 microversion: 2.1 time: 0.103201 Jan 19 16:12:15.512206 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 615/1296] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:12:15 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 29954 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:12:15.515577 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-a9e36929-e90a-4a56-bcf5-5c71f1ed5eed req-c0d32c84-313f-4d1d-a8a8-0bde4082af74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c1319b6-bda0-474e-bf40-08f9106fa169", "name": "network-vif-unplugged", "status": "completed", "tag": "a7371518-3a83-43f3-a73a-17f850f9c369"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:15.527074 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:12:15.527074 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:12:15.527074 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-a9e36929-e90a-4a56-bcf5-5c71f1ed5eed req-c0d32c84-313f-4d1d-a8a8-0bde4082af74 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:15.527074 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-a9e36929-e90a-4a56-bcf5-5c71f1ed5eed req-c0d32c84-313f-4d1d-a8a8-0bde4082af74 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:15.536861 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-a9e36929-e90a-4a56-bcf5-5c71f1ed5eed req-c0d32c84-313f-4d1d-a8a8-0bde4082af74 service nova] Creating event network-vif-unplugged:a7371518-3a83-43f3-a73a-17f850f9c369 for instance 9c1319b6-bda0-474e-bf40-08f9106fa169 on hv-cinder-82002 Jan 19 16:12:15.542229 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-a9e36929-e90a-4a56-bcf5-5c71f1ed5eed req-c0d32c84-313f-4d1d-a8a8-0bde4082af74 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030356 Jan 19 16:12:15.542985 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 682/1297] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:12:16.176052 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c2783749-dd7b-493e-9f2a-bc8cd250eda9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:16.176769 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c2783749-dd7b-493e-9f2a-bc8cd250eda9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:16.185458 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c2783749-dd7b-493e-9f2a-bc8cd250eda9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:16.185856 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c2783749-dd7b-493e-9f2a-bc8cd250eda9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:16.186994 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c2783749-dd7b-493e-9f2a-bc8cd250eda9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:16.187435 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c2783749-dd7b-493e-9f2a-bc8cd250eda9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:16.217499 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ec9c6ef5-bcec-41fa-9491-ca27f58bf8d9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:16.218170 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ec9c6ef5-bcec-41fa-9491-ca27f58bf8d9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:16.224502 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ec9c6ef5-bcec-41fa-9491-ca27f58bf8d9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:16.224947 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ec9c6ef5-bcec-41fa-9491-ca27f58bf8d9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:16.226324 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ec9c6ef5-bcec-41fa-9491-ca27f58bf8d9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:16.226758 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ec9c6ef5-bcec-41fa-9491-ca27f58bf8d9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:16.322540 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c2783749-dd7b-493e-9f2a-bc8cd250eda9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:16.330203 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c2783749-dd7b-493e-9f2a-bc8cd250eda9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1452 microversion: 2.1 time: 0.158196 Jan 19 16:12:16.330800 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 616/1298] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:12:16 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:12:16.345677 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d86081a4-1475-4e5a-9d5d-862d406556f6 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:16.346288 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d86081a4-1475-4e5a-9d5d-862d406556f6 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:16.352729 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d86081a4-1475-4e5a-9d5d-862d406556f6 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:16.353173 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d86081a4-1475-4e5a-9d5d-862d406556f6 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:16.353957 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d86081a4-1475-4e5a-9d5d-862d406556f6 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:16.354386 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d86081a4-1475-4e5a-9d5d-862d406556f6 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:16.358640 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ec9c6ef5-bcec-41fa-9491-ca27f58bf8d9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:16.367544 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ec9c6ef5-bcec-41fa-9491-ca27f58bf8d9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:16.369135 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ec9c6ef5-bcec-41fa-9491-ca27f58bf8d9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:16.370403 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ec9c6ef5-bcec-41fa-9491-ca27f58bf8d9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1664 microversion: 2.20 time: 0.157758 Jan 19 16:12:16.371046 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 683/1299] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:16 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1664 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:12:16.392348 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c9d552df-8de7-4dfd-b18c-45ed061f8a01 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62df19be-e82a-4099-81e7-c3ddbea7b626"}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:16.393634 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c9d552df-8de7-4dfd-b18c-45ed061f8a01 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:16.399995 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c9d552df-8de7-4dfd-b18c-45ed061f8a01 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:16.400514 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c9d552df-8de7-4dfd-b18c-45ed061f8a01 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:16.401294 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c9d552df-8de7-4dfd-b18c-45ed061f8a01 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:16.401723 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c9d552df-8de7-4dfd-b18c-45ed061f8a01 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:16.501528 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d86081a4-1475-4e5a-9d5d-862d406556f6 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:16.507937 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d86081a4-1475-4e5a-9d5d-862d406556f6 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1452 microversion: 2.1 time: 0.165857 Jan 19 16:12:16.508508 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 617/1300] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:12:16 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:12:16.525576 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-68169242-7483-4bc3-90a8-c4f76100e8d2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:16.526795 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-68169242-7483-4bc3-90a8-c4f76100e8d2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:16.533438 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-68169242-7483-4bc3-90a8-c4f76100e8d2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:16.533894 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-68169242-7483-4bc3-90a8-c4f76100e8d2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:16.534692 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-68169242-7483-4bc3-90a8-c4f76100e8d2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:16.535165 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-68169242-7483-4bc3-90a8-c4f76100e8d2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:16.611664 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-68169242-7483-4bc3-90a8-c4f76100e8d2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 31705 microversion: 2.1 time: 0.091136 Jan 19 16:12:16.612533 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 618/1301] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:12:16 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 31705 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:12:17.402346 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c9d552df-8de7-4dfd-b18c-45ed061f8a01 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.013847 Jan 19 16:12:17.403420 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 684/1302] 10.222.0.58 () {62 vars in 1363 bytes} [Wed Jan 19 16:12:16 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/os-volume_attachments => generated 188 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:12:17.518237 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-9afd1737-b28f-47ee-98a9-471a3cebb875 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:17.519267 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-9afd1737-b28f-47ee-98a9-471a3cebb875 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:17.526855 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9afd1737-b28f-47ee-98a9-471a3cebb875 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:17.527320 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9afd1737-b28f-47ee-98a9-471a3cebb875 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:17.528110 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9afd1737-b28f-47ee-98a9-471a3cebb875 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:17.528537 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9afd1737-b28f-47ee-98a9-471a3cebb875 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:17.624275 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-6e0ec719-1f17-4bf2-8be2-ee05e81c40e5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:17.625487 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-6e0ec719-1f17-4bf2-8be2-ee05e81c40e5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:17.632476 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6e0ec719-1f17-4bf2-8be2-ee05e81c40e5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:17.636065 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6e0ec719-1f17-4bf2-8be2-ee05e81c40e5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:17.636065 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6e0ec719-1f17-4bf2-8be2-ee05e81c40e5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:17.636065 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6e0ec719-1f17-4bf2-8be2-ee05e81c40e5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:17.703987 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-6e0ec719-1f17-4bf2-8be2-ee05e81c40e5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 33280 microversion: 2.1 time: 0.083393 Jan 19 16:12:17.708235 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 685/1303] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:12:17 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 33280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:12:18.051450 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-9afd1737-b28f-47ee-98a9-471a3cebb875 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/os-volume_attachments/62df19be-e82a-4099-81e7-c3ddbea7b626" status: 202 len: 0 microversion: 2.20 time: 0.538492 Jan 19 16:12:18.052263 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 619/1304] 10.222.0.58 () {60 vars in 1456 bytes} [Wed Jan 19 16:12:17 2022] DELETE /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/os-volume_attachments/62df19be-e82a-4099-81e7-c3ddbea7b626 => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:12:18.107821 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-31ac41cc-c598-4f0f-b83d-558029141e6d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:18.108474 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-31ac41cc-c598-4f0f-b83d-558029141e6d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:18.115445 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-31ac41cc-c598-4f0f-b83d-558029141e6d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:18.115890 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-31ac41cc-c598-4f0f-b83d-558029141e6d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:18.116670 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-31ac41cc-c598-4f0f-b83d-558029141e6d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:18.117102 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-31ac41cc-c598-4f0f-b83d-558029141e6d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:18.340347 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-31ac41cc-c598-4f0f-b83d-558029141e6d tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action" status: 202 len: 0 microversion: 2.20 time: 0.236694 Jan 19 16:12:18.340964 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 686/1305] 10.222.0.58 () {62 vars in 1318 bytes} [Wed Jan 19 16:12:18 2022] POST /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:12:18.348928 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-08e71d84-2aba-4c66-ba6f-efe35367d140 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:18.349533 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-08e71d84-2aba-4c66-ba6f-efe35367d140 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:18.356850 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-08e71d84-2aba-4c66-ba6f-efe35367d140 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:18.357307 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-08e71d84-2aba-4c66-ba6f-efe35367d140 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:18.358189 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-08e71d84-2aba-4c66-ba6f-efe35367d140 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:18.359396 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-08e71d84-2aba-4c66-ba6f-efe35367d140 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:18.500965 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-08e71d84-2aba-4c66-ba6f-efe35367d140 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:18.511268 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-08e71d84-2aba-4c66-ba6f-efe35367d140 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:18.513402 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-08e71d84-2aba-4c66-ba6f-efe35367d140 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:18.515635 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-08e71d84-2aba-4c66-ba6f-efe35367d140 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1672 microversion: 2.20 time: 0.170520 Jan 19 16:12:18.516637 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 620/1306] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:18 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:12:18.716804 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-9b51aaf1-48fa-4dff-b670-b69cf44e3cbe tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:18.717624 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-9b51aaf1-48fa-4dff-b670-b69cf44e3cbe tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:18.729024 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9b51aaf1-48fa-4dff-b670-b69cf44e3cbe tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:18.729753 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9b51aaf1-48fa-4dff-b670-b69cf44e3cbe tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:18.730609 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9b51aaf1-48fa-4dff-b670-b69cf44e3cbe tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:18.731151 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9b51aaf1-48fa-4dff-b670-b69cf44e3cbe tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:18.810984 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-9b51aaf1-48fa-4dff-b670-b69cf44e3cbe tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 34257 microversion: 2.1 time: 0.098280 Jan 19 16:12:18.816777 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-14d8387e-cff1-4208-bf00-eeaa5610ab38 req-96bd3290-8e1a-4215-af4f-b91070ad6108 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8fc83e4-334a-4135-8e9a-ffa59df1a1d0", "tag": "b2227ef0-87de-42b4-a1ba-9d3a0612b9ac"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:18.818361 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 687/1307] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:12:18 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 34257 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:12:18.823072 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:12:18.823072 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:12:18.830534 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-14d8387e-cff1-4208-bf00-eeaa5610ab38 req-96bd3290-8e1a-4215-af4f-b91070ad6108 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:18.830992 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-14d8387e-cff1-4208-bf00-eeaa5610ab38 req-96bd3290-8e1a-4215-af4f-b91070ad6108 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:18.843137 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-14d8387e-cff1-4208-bf00-eeaa5610ab38 req-96bd3290-8e1a-4215-af4f-b91070ad6108 service nova] Creating event network-changed:b2227ef0-87de-42b4-a1ba-9d3a0612b9ac for instance f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 on hv-cinder-82002 Jan 19 16:12:18.848829 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-14d8387e-cff1-4208-bf00-eeaa5610ab38 req-96bd3290-8e1a-4215-af4f-b91070ad6108 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035970 Jan 19 16:12:18.850053 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 621/1308] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:12:19.535936 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-119ba3c7-3de9-4264-8113-ad6c4feaba45 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:19.536758 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-119ba3c7-3de9-4264-8113-ad6c4feaba45 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:19.544932 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-119ba3c7-3de9-4264-8113-ad6c4feaba45 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:19.545371 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-119ba3c7-3de9-4264-8113-ad6c4feaba45 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:19.546360 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-119ba3c7-3de9-4264-8113-ad6c4feaba45 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:19.546784 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-119ba3c7-3de9-4264-8113-ad6c4feaba45 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:19.689082 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-119ba3c7-3de9-4264-8113-ad6c4feaba45 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:19.697910 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-119ba3c7-3de9-4264-8113-ad6c4feaba45 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:19.699831 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-119ba3c7-3de9-4264-8113-ad6c4feaba45 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:19.701084 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-119ba3c7-3de9-4264-8113-ad6c4feaba45 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1672 microversion: 2.20 time: 0.169466 Jan 19 16:12:19.701872 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 688/1309] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:19 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:12:19.829499 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ea5c86ce-9b4f-4e20-bf50-ca3d44549436 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:19.831388 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-ea5c86ce-9b4f-4e20-bf50-ca3d44549436 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:19.838855 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ea5c86ce-9b4f-4e20-bf50-ca3d44549436 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:19.839319 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ea5c86ce-9b4f-4e20-bf50-ca3d44549436 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:19.840115 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ea5c86ce-9b4f-4e20-bf50-ca3d44549436 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:19.840744 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ea5c86ce-9b4f-4e20-bf50-ca3d44549436 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:19.948602 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-ea5c86ce-9b4f-4e20-bf50-ca3d44549436 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 35389 microversion: 2.1 time: 0.123064 Jan 19 16:12:19.952851 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 622/1310] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:12:19 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 35389 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:12:20.720390 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f707b266-886b-49da-9c7f-e926e3657665 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:20.720989 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f707b266-886b-49da-9c7f-e926e3657665 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:20.727809 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f707b266-886b-49da-9c7f-e926e3657665 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:20.728259 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f707b266-886b-49da-9c7f-e926e3657665 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:20.729064 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f707b266-886b-49da-9c7f-e926e3657665 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:20.729496 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f707b266-886b-49da-9c7f-e926e3657665 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:20.864630 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f707b266-886b-49da-9c7f-e926e3657665 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:20.873000 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f707b266-886b-49da-9c7f-e926e3657665 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:20.874523 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f707b266-886b-49da-9c7f-e926e3657665 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:20.875709 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f707b266-886b-49da-9c7f-e926e3657665 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1730 microversion: 2.20 time: 0.159101 Jan 19 16:12:20.876268 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 689/1311] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:20 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:12:20.962405 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-516a690d-8e50-46b8-9626-6b6f13d8e008 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:20.964492 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-516a690d-8e50-46b8-9626-6b6f13d8e008 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:20.972056 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-516a690d-8e50-46b8-9626-6b6f13d8e008 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:20.972503 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-516a690d-8e50-46b8-9626-6b6f13d8e008 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:20.973655 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-516a690d-8e50-46b8-9626-6b6f13d8e008 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:20.974084 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-516a690d-8e50-46b8-9626-6b6f13d8e008 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:21.053111 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-516a690d-8e50-46b8-9626-6b6f13d8e008 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 36695 microversion: 2.1 time: 0.095218 Jan 19 16:12:21.057444 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 623/1312] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:12:20 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 36695 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:12:21.894256 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5a91a056-b261-4c08-8c52-1fff2561f21f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:21.894790 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5a91a056-b261-4c08-8c52-1fff2561f21f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:21.901195 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5a91a056-b261-4c08-8c52-1fff2561f21f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:21.901636 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5a91a056-b261-4c08-8c52-1fff2561f21f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:21.902410 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5a91a056-b261-4c08-8c52-1fff2561f21f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:21.902839 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5a91a056-b261-4c08-8c52-1fff2561f21f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:22.066534 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-9af4fa4f-db46-46f1-b819-ccba702fd2a5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:22.067668 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-9af4fa4f-db46-46f1-b819-ccba702fd2a5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:22.075400 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9af4fa4f-db46-46f1-b819-ccba702fd2a5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:22.076036 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9af4fa4f-db46-46f1-b819-ccba702fd2a5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:22.076988 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9af4fa4f-db46-46f1-b819-ccba702fd2a5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:22.077423 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9af4fa4f-db46-46f1-b819-ccba702fd2a5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:22.091699 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5a91a056-b261-4c08-8c52-1fff2561f21f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:22.101147 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5a91a056-b261-4c08-8c52-1fff2561f21f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:22.102819 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5a91a056-b261-4c08-8c52-1fff2561f21f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:22.104167 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5a91a056-b261-4c08-8c52-1fff2561f21f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1730 microversion: 2.20 time: 0.213824 Jan 19 16:12:22.104859 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 690/1313] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:21 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1730 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:12:23.123653 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ece7a954-84c4-4089-97c7-f96e461043c9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:23.124364 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ece7a954-84c4-4089-97c7-f96e461043c9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:23.130901 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ece7a954-84c4-4089-97c7-f96e461043c9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:23.131889 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ece7a954-84c4-4089-97c7-f96e461043c9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:23.132560 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ece7a954-84c4-4089-97c7-f96e461043c9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:23.132992 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ece7a954-84c4-4089-97c7-f96e461043c9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:23.281041 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ece7a954-84c4-4089-97c7-f96e461043c9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:23.289699 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ece7a954-84c4-4089-97c7-f96e461043c9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:23.291751 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-ece7a954-84c4-4089-97c7-f96e461043c9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:23.293005 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ece7a954-84c4-4089-97c7-f96e461043c9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1730 microversion: 2.20 time: 0.174915 Jan 19 16:12:23.293651 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 691/1314] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:23 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:12:24.312511 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-2d380d24-ba91-45e7-bec1-83975b56074f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:24.313520 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-2d380d24-ba91-45e7-bec1-83975b56074f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:24.321031 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2d380d24-ba91-45e7-bec1-83975b56074f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:24.321860 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2d380d24-ba91-45e7-bec1-83975b56074f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:24.322734 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2d380d24-ba91-45e7-bec1-83975b56074f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:24.323206 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-2d380d24-ba91-45e7-bec1-83975b56074f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:24.460193 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-2d380d24-ba91-45e7-bec1-83975b56074f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:24.468462 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-2d380d24-ba91-45e7-bec1-83975b56074f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:24.469968 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-2d380d24-ba91-45e7-bec1-83975b56074f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:24.471407 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-2d380d24-ba91-45e7-bec1-83975b56074f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1730 microversion: 2.20 time: 0.162621 Jan 19 16:12:24.471975 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 692/1315] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:24 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:12:25.489828 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5fcf2e00-361d-4e14-bad0-50d874bc8f85 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:25.490483 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5fcf2e00-361d-4e14-bad0-50d874bc8f85 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:25.497214 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5fcf2e00-361d-4e14-bad0-50d874bc8f85 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:25.497648 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5fcf2e00-361d-4e14-bad0-50d874bc8f85 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:25.498421 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5fcf2e00-361d-4e14-bad0-50d874bc8f85 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:25.498847 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5fcf2e00-361d-4e14-bad0-50d874bc8f85 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:25.644997 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5fcf2e00-361d-4e14-bad0-50d874bc8f85 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:25.653443 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5fcf2e00-361d-4e14-bad0-50d874bc8f85 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:25.654963 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5fcf2e00-361d-4e14-bad0-50d874bc8f85 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:25.656191 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5fcf2e00-361d-4e14-bad0-50d874bc8f85 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1730 microversion: 2.20 time: 0.170176 Jan 19 16:12:25.656952 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 693/1316] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:25 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:12:26.676123 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c58b3384-2485-4fd4-a393-2e1b9c6fcbe9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:26.676942 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c58b3384-2485-4fd4-a393-2e1b9c6fcbe9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:26.683974 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c58b3384-2485-4fd4-a393-2e1b9c6fcbe9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:26.684485 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c58b3384-2485-4fd4-a393-2e1b9c6fcbe9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:26.685360 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c58b3384-2485-4fd4-a393-2e1b9c6fcbe9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:26.685819 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c58b3384-2485-4fd4-a393-2e1b9c6fcbe9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:26.836426 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c58b3384-2485-4fd4-a393-2e1b9c6fcbe9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:26.856831 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c58b3384-2485-4fd4-a393-2e1b9c6fcbe9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:26.860394 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c58b3384-2485-4fd4-a393-2e1b9c6fcbe9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:26.860394 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c58b3384-2485-4fd4-a393-2e1b9c6fcbe9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1730 microversion: 2.20 time: 0.187374 Jan 19 16:12:26.860670 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 694/1317] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:26 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:12:27.892792 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-9efdfe27-eeb3-4b8f-9463-cf5a96064008 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:27.892792 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-9efdfe27-eeb3-4b8f-9463-cf5a96064008 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:27.892792 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9efdfe27-eeb3-4b8f-9463-cf5a96064008 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:27.892792 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9efdfe27-eeb3-4b8f-9463-cf5a96064008 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:27.894485 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9efdfe27-eeb3-4b8f-9463-cf5a96064008 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:27.894485 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9efdfe27-eeb3-4b8f-9463-cf5a96064008 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:28.062300 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-9efdfe27-eeb3-4b8f-9463-cf5a96064008 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:28.071008 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-9efdfe27-eeb3-4b8f-9463-cf5a96064008 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:28.072641 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-9efdfe27-eeb3-4b8f-9463-cf5a96064008 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:28.073737 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-9efdfe27-eeb3-4b8f-9463-cf5a96064008 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1730 microversion: 2.20 time: 0.197234 Jan 19 16:12:28.074301 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 695/1318] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:27 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:12:29.094256 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-bb652660-bae0-434b-b3f5-99657a4fe9db tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:29.095024 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-bb652660-bae0-434b-b3f5-99657a4fe9db tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:29.101754 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bb652660-bae0-434b-b3f5-99657a4fe9db tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:29.102312 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bb652660-bae0-434b-b3f5-99657a4fe9db tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:29.103112 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bb652660-bae0-434b-b3f5-99657a4fe9db tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:29.103544 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bb652660-bae0-434b-b3f5-99657a4fe9db tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:29.246370 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-bb652660-bae0-434b-b3f5-99657a4fe9db tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:29.254827 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-bb652660-bae0-434b-b3f5-99657a4fe9db tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:29.256398 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-bb652660-bae0-434b-b3f5-99657a4fe9db tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:29.258185 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-bb652660-bae0-434b-b3f5-99657a4fe9db tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1730 microversion: 2.20 time: 0.168050 Jan 19 16:12:29.258744 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 696/1319] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:29 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:12:30.277072 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5739149e-4abf-4dfb-b98f-f76b6e0c6ad9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:30.278324 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5739149e-4abf-4dfb-b98f-f76b6e0c6ad9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:30.285204 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5739149e-4abf-4dfb-b98f-f76b6e0c6ad9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:30.285639 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5739149e-4abf-4dfb-b98f-f76b6e0c6ad9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:30.286615 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5739149e-4abf-4dfb-b98f-f76b6e0c6ad9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:30.287069 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5739149e-4abf-4dfb-b98f-f76b6e0c6ad9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:30.430448 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5739149e-4abf-4dfb-b98f-f76b6e0c6ad9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:30.439139 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5739149e-4abf-4dfb-b98f-f76b6e0c6ad9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:30.440653 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5739149e-4abf-4dfb-b98f-f76b6e0c6ad9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:30.441829 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5739149e-4abf-4dfb-b98f-f76b6e0c6ad9 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1730 microversion: 2.20 time: 0.169201 Jan 19 16:12:30.442583 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 697/1320] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:30 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:12:30.563406 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:12:30.569087 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: Wed Jan 19 16:12:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action (ip 10.222.0.58) !!! Jan 19 16:12:31.461051 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8a3651b2-4ac6-475a-94a8-fb83decf8a5c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:31.461751 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-8a3651b2-4ac6-475a-94a8-fb83decf8a5c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:31.468446 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8a3651b2-4ac6-475a-94a8-fb83decf8a5c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:31.468887 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8a3651b2-4ac6-475a-94a8-fb83decf8a5c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:31.469669 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8a3651b2-4ac6-475a-94a8-fb83decf8a5c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:31.470109 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8a3651b2-4ac6-475a-94a8-fb83decf8a5c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:31.614602 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8a3651b2-4ac6-475a-94a8-fb83decf8a5c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:31.622768 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8a3651b2-4ac6-475a-94a8-fb83decf8a5c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:31.624580 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8a3651b2-4ac6-475a-94a8-fb83decf8a5c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:31.625928 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-8a3651b2-4ac6-475a-94a8-fb83decf8a5c tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1730 microversion: 2.20 time: 0.169219 Jan 19 16:12:31.626617 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 698/1321] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:31 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:12:32.644207 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5ecb05a8-b2f1-4268-88d6-8f4b80f6aca5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:32.644847 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5ecb05a8-b2f1-4268-88d6-8f4b80f6aca5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:32.652057 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5ecb05a8-b2f1-4268-88d6-8f4b80f6aca5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:32.652559 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5ecb05a8-b2f1-4268-88d6-8f4b80f6aca5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:32.653318 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5ecb05a8-b2f1-4268-88d6-8f4b80f6aca5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:32.653752 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5ecb05a8-b2f1-4268-88d6-8f4b80f6aca5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:32.788553 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5ecb05a8-b2f1-4268-88d6-8f4b80f6aca5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:32.796456 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5ecb05a8-b2f1-4268-88d6-8f4b80f6aca5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:32.797971 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5ecb05a8-b2f1-4268-88d6-8f4b80f6aca5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:32.799136 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5ecb05a8-b2f1-4268-88d6-8f4b80f6aca5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1730 microversion: 2.20 time: 0.158672 Jan 19 16:12:32.799706 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 699/1322] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:32 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:12:33.817571 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c1603751-cefc-4874-b125-704aa5419330 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:33.818221 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c1603751-cefc-4874-b125-704aa5419330 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:33.824540 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c1603751-cefc-4874-b125-704aa5419330 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:33.831585 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c1603751-cefc-4874-b125-704aa5419330 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:33.831585 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c1603751-cefc-4874-b125-704aa5419330 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:33.831585 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c1603751-cefc-4874-b125-704aa5419330 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:33.964324 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c1603751-cefc-4874-b125-704aa5419330 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:33.972913 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c1603751-cefc-4874-b125-704aa5419330 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:33.974435 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c1603751-cefc-4874-b125-704aa5419330 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:33.975685 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c1603751-cefc-4874-b125-704aa5419330 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1730 microversion: 2.20 time: 0.161907 Jan 19 16:12:33.976843 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 700/1323] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:33 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:12:34.994437 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a0c834b8-1417-4861-9db4-efa4a8053f83 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:34.995153 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a0c834b8-1417-4861-9db4-efa4a8053f83 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:35.001733 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a0c834b8-1417-4861-9db4-efa4a8053f83 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:35.002183 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a0c834b8-1417-4861-9db4-efa4a8053f83 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:35.003000 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a0c834b8-1417-4861-9db4-efa4a8053f83 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:35.003444 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a0c834b8-1417-4861-9db4-efa4a8053f83 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:35.281700 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a0c834b8-1417-4861-9db4-efa4a8053f83 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:35.290673 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a0c834b8-1417-4861-9db4-efa4a8053f83 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:35.292231 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a0c834b8-1417-4861-9db4-efa4a8053f83 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:35.293414 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a0c834b8-1417-4861-9db4-efa4a8053f83 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1730 microversion: 2.20 time: 0.303536 Jan 19 16:12:35.293993 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 701/1324] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:34 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1730 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:12:35.310700 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-9af4fa4f-db46-46f1-b819-ccba702fd2a5 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action" status: 200 len: 38314 microversion: 2.1 time: 13.249291 Jan 19 16:12:35.311699 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 624/1325] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:12:22 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/action => generated 38314 bytes in 13252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:12:35.328992 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c48cdd70-e4e6-4f98-a491-7f25ae7a6dba tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:35.329794 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c48cdd70-e4e6-4f98-a491-7f25ae7a6dba tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:35.337671 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c48cdd70-e4e6-4f98-a491-7f25ae7a6dba tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:35.338116 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c48cdd70-e4e6-4f98-a491-7f25ae7a6dba tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:35.338929 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c48cdd70-e4e6-4f98-a491-7f25ae7a6dba tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:35.339403 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c48cdd70-e4e6-4f98-a491-7f25ae7a6dba tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:35.369965 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c48cdd70-e4e6-4f98-a491-7f25ae7a6dba tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/ips" status: 200 len: 144 microversion: 2.1 time: 0.047990 Jan 19 16:12:35.370695 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 702/1326] 10.222.0.58 () {58 vars in 1247 bytes} [Wed Jan 19 16:12:35 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/ips => generated 144 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:12:36.313677 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-bed1e9c8-da6e-4396-8ee9-e56cfc40f643 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:36.314418 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-bed1e9c8-da6e-4396-8ee9-e56cfc40f643 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:36.324520 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bed1e9c8-da6e-4396-8ee9-e56cfc40f643 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:36.324981 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bed1e9c8-da6e-4396-8ee9-e56cfc40f643 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:36.325856 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bed1e9c8-da6e-4396-8ee9-e56cfc40f643 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:36.326297 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bed1e9c8-da6e-4396-8ee9-e56cfc40f643 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:36.513572 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-bed1e9c8-da6e-4396-8ee9-e56cfc40f643 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:36.521956 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-bed1e9c8-da6e-4396-8ee9-e56cfc40f643 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:36.523475 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-bed1e9c8-da6e-4396-8ee9-e56cfc40f643 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:36.524650 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-bed1e9c8-da6e-4396-8ee9-e56cfc40f643 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1730 microversion: 2.20 time: 0.215230 Jan 19 16:12:36.525203 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 625/1327] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:36 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1730 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:12:37.124041 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-82c003eb-1f1b-48db-bc04-13395b15e124 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7f2fe9d-4c86-4b4e-b3af-8a8b98d5aec5"}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:37.125147 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-82c003eb-1f1b-48db-bc04-13395b15e124 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:37.132412 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-82c003eb-1f1b-48db-bc04-13395b15e124 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:37.133375 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-82c003eb-1f1b-48db-bc04-13395b15e124 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:37.134172 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-82c003eb-1f1b-48db-bc04-13395b15e124 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:37.134603 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-82c003eb-1f1b-48db-bc04-13395b15e124 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:37.543593 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c5ca66f3-1252-43fc-8f50-931d3aefb8e0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:37.544570 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c5ca66f3-1252-43fc-8f50-931d3aefb8e0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:37.551097 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c5ca66f3-1252-43fc-8f50-931d3aefb8e0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:37.551563 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c5ca66f3-1252-43fc-8f50-931d3aefb8e0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:37.552499 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c5ca66f3-1252-43fc-8f50-931d3aefb8e0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:37.552950 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c5ca66f3-1252-43fc-8f50-931d3aefb8e0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:37.691090 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c5ca66f3-1252-43fc-8f50-931d3aefb8e0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:37.699440 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c5ca66f3-1252-43fc-8f50-931d3aefb8e0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:37.700946 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c5ca66f3-1252-43fc-8f50-931d3aefb8e0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:37.702235 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c5ca66f3-1252-43fc-8f50-931d3aefb8e0 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1730 microversion: 2.20 time: 0.163347 Jan 19 16:12:37.702862 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 626/1328] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:37 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:12:37.938519 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-82c003eb-1f1b-48db-bc04-13395b15e124 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.818205 Jan 19 16:12:37.940390 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 703/1329] 10.222.0.58 () {60 vars in 1322 bytes} [Wed Jan 19 16:12:37 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/os-volume_attachments => generated 194 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:12:38.721298 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e3df773e-4795-44ec-bb38-b9f45fc53b39 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:38.721939 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-e3df773e-4795-44ec-bb38-b9f45fc53b39 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:38.729760 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e3df773e-4795-44ec-bb38-b9f45fc53b39 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:38.730276 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e3df773e-4795-44ec-bb38-b9f45fc53b39 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:38.731167 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e3df773e-4795-44ec-bb38-b9f45fc53b39 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:38.731596 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e3df773e-4795-44ec-bb38-b9f45fc53b39 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:38.874067 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e3df773e-4795-44ec-bb38-b9f45fc53b39 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:38.883173 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e3df773e-4795-44ec-bb38-b9f45fc53b39 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:38.884739 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e3df773e-4795-44ec-bb38-b9f45fc53b39 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:38.885917 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e3df773e-4795-44ec-bb38-b9f45fc53b39 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1730 microversion: 2.20 time: 0.168903 Jan 19 16:12:38.886476 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 627/1330] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:38 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:12:39.502196 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-3ff44b96-4254-48e5-8a15-8f7163b19ff6 req-efa0d2b9-10b3-456d-ae9a-bdbf4c192259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c1319b6-bda0-474e-bf40-08f9106fa169", "name": "network-vif-plugged", "status": "completed", "tag": "a7371518-3a83-43f3-a73a-17f850f9c369"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:39.503894 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:12:39.503894 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:12:39.511799 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-3ff44b96-4254-48e5-8a15-8f7163b19ff6 req-efa0d2b9-10b3-456d-ae9a-bdbf4c192259 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:39.512254 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-3ff44b96-4254-48e5-8a15-8f7163b19ff6 req-efa0d2b9-10b3-456d-ae9a-bdbf4c192259 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:39.526120 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-3ff44b96-4254-48e5-8a15-8f7163b19ff6 req-efa0d2b9-10b3-456d-ae9a-bdbf4c192259 service nova] Creating event network-vif-plugged:a7371518-3a83-43f3-a73a-17f850f9c369 for instance 9c1319b6-bda0-474e-bf40-08f9106fa169 on hv-cinder-82002 Jan 19 16:12:39.532563 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-3ff44b96-4254-48e5-8a15-8f7163b19ff6 req-efa0d2b9-10b3-456d-ae9a-bdbf4c192259 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033687 Jan 19 16:12:39.532563 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 704/1331] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:12:39.907133 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-9b5181df-78f3-43ad-8626-b25d4a717065 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:39.907783 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-9b5181df-78f3-43ad-8626-b25d4a717065 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:39.915437 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9b5181df-78f3-43ad-8626-b25d4a717065 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:39.915889 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9b5181df-78f3-43ad-8626-b25d4a717065 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:39.916716 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9b5181df-78f3-43ad-8626-b25d4a717065 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:39.917153 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9b5181df-78f3-43ad-8626-b25d4a717065 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:40.091152 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-9b5181df-78f3-43ad-8626-b25d4a717065 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:40.100637 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-9b5181df-78f3-43ad-8626-b25d4a717065 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:40.103452 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-9b5181df-78f3-43ad-8626-b25d4a717065 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:40.104522 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-9b5181df-78f3-43ad-8626-b25d4a717065 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1730 microversion: 2.20 time: 0.201718 Jan 19 16:12:40.105630 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 628/1332] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:39 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:12:41.129263 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-08f9cb97-f428-4785-80a9-974947c1aadf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:41.130369 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-08f9cb97-f428-4785-80a9-974947c1aadf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:41.142357 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-08f9cb97-f428-4785-80a9-974947c1aadf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:41.143207 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-08f9cb97-f428-4785-80a9-974947c1aadf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:41.144700 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-08f9cb97-f428-4785-80a9-974947c1aadf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:41.145497 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-08f9cb97-f428-4785-80a9-974947c1aadf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:41.321379 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-08f9cb97-f428-4785-80a9-974947c1aadf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:41.330628 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-08f9cb97-f428-4785-80a9-974947c1aadf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:41.332337 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-08f9cb97-f428-4785-80a9-974947c1aadf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:41.333520 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-08f9cb97-f428-4785-80a9-974947c1aadf tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1730 microversion: 2.20 time: 0.213202 Jan 19 16:12:41.334090 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 705/1333] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:41 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1730 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:12:42.351762 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-2e9c08ec-8738-435e-88b3-490374653bc8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:42.352486 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-2e9c08ec-8738-435e-88b3-490374653bc8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:42.358878 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2e9c08ec-8738-435e-88b3-490374653bc8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:42.359363 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2e9c08ec-8738-435e-88b3-490374653bc8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:42.360156 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2e9c08ec-8738-435e-88b3-490374653bc8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:42.360594 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2e9c08ec-8738-435e-88b3-490374653bc8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:42.508567 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-2e9c08ec-8738-435e-88b3-490374653bc8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:42.517081 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-2e9c08ec-8738-435e-88b3-490374653bc8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:42.518612 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-2e9c08ec-8738-435e-88b3-490374653bc8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:42.519910 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-2e9c08ec-8738-435e-88b3-490374653bc8 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1730 microversion: 2.20 time: 0.172391 Jan 19 16:12:42.520498 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 629/1334] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:42 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:12:43.540086 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8a6d2dd5-c009-4440-96e7-2459f87a9b04 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:43.540738 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-8a6d2dd5-c009-4440-96e7-2459f87a9b04 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:43.547817 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8a6d2dd5-c009-4440-96e7-2459f87a9b04 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:43.548311 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8a6d2dd5-c009-4440-96e7-2459f87a9b04 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:43.549155 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8a6d2dd5-c009-4440-96e7-2459f87a9b04 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:43.549632 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8a6d2dd5-c009-4440-96e7-2459f87a9b04 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:43.731804 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8a6d2dd5-c009-4440-96e7-2459f87a9b04 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:43.746911 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8a6d2dd5-c009-4440-96e7-2459f87a9b04 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:43.749979 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8a6d2dd5-c009-4440-96e7-2459f87a9b04 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:12:43.751424 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-8a6d2dd5-c009-4440-96e7-2459f87a9b04 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1717 microversion: 2.20 time: 0.216078 Jan 19 16:12:43.752004 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 706/1335] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:12:43 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1717 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:12:46.483538 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-987b4068-e1bc-4fe7-b695-bbc0e062397c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:46.484446 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-987b4068-e1bc-4fe7-b695-bbc0e062397c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:46.490932 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-987b4068-e1bc-4fe7-b695-bbc0e062397c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:46.491406 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-987b4068-e1bc-4fe7-b695-bbc0e062397c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:46.492735 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-987b4068-e1bc-4fe7-b695-bbc0e062397c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:46.493164 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-987b4068-e1bc-4fe7-b695-bbc0e062397c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:46.528803 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-987b4068-e1bc-4fe7-b695-bbc0e062397c tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049073 Jan 19 16:12:46.529380 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 630/1336] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:12:46 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:12:46.539226 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3a08837f-76f1-41eb-9659-bf9b10978dde tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:46.539754 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3a08837f-76f1-41eb-9659-bf9b10978dde tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:46.548315 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3a08837f-76f1-41eb-9659-bf9b10978dde tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:46.548934 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3a08837f-76f1-41eb-9659-bf9b10978dde tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:46.549857 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3a08837f-76f1-41eb-9659-bf9b10978dde tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:46.550387 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3a08837f-76f1-41eb-9659-bf9b10978dde tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:46.585815 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3a08837f-76f1-41eb-9659-bf9b10978dde tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/os-volume_attachments/c7f2fe9d-4c86-4b4e-b3af-8a8b98d5aec5" status: 200 len: 194 microversion: 2.1 time: 0.050434 Jan 19 16:12:46.598479 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 707/1337] 10.222.0.58 () {58 vars in 1412 bytes} [Wed Jan 19 16:12:46 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/os-volume_attachments/c7f2fe9d-4c86-4b4e-b3af-8a8b98d5aec5 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:12:48.389614 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-49f87902-a202-4e17-8d9e-d048bbfb9941 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "579b407b-b678-4893-b037-2160dbe53b3f"}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:12:48.390691 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-49f87902-a202-4e17-8d9e-d048bbfb9941 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:48.397328 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-49f87902-a202-4e17-8d9e-d048bbfb9941 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:48.397767 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-49f87902-a202-4e17-8d9e-d048bbfb9941 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:48.399226 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-49f87902-a202-4e17-8d9e-d048bbfb9941 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:48.399657 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-49f87902-a202-4e17-8d9e-d048bbfb9941 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:49.366441 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-49f87902-a202-4e17-8d9e-d048bbfb9941 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.980458 Jan 19 16:12:49.367952 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 631/1338] 10.222.0.58 () {60 vars in 1322 bytes} [Wed Jan 19 16:12:48 2022] POST /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/os-volume_attachments => generated 194 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:12:56.843236 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d1cd98a7-b5ff-4dcf-83f6-8ba2cab4e647 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:56.844176 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-d1cd98a7-b5ff-4dcf-83f6-8ba2cab4e647 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:56.851091 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d1cd98a7-b5ff-4dcf-83f6-8ba2cab4e647 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:56.851496 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d1cd98a7-b5ff-4dcf-83f6-8ba2cab4e647 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:56.852596 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d1cd98a7-b5ff-4dcf-83f6-8ba2cab4e647 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:56.852728 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d1cd98a7-b5ff-4dcf-83f6-8ba2cab4e647 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:56.883628 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-d1cd98a7-b5ff-4dcf-83f6-8ba2cab4e647 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044172 Jan 19 16:12:56.884201 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 708/1339] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:12:56 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:12:57.079167 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f56d9a75-b132-49c8-9d5c-29e5c028fe22 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:57.079765 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-f56d9a75-b132-49c8-9d5c-29e5c028fe22 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:57.085864 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f56d9a75-b132-49c8-9d5c-29e5c028fe22 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:57.086300 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f56d9a75-b132-49c8-9d5c-29e5c028fe22 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:57.087089 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f56d9a75-b132-49c8-9d5c-29e5c028fe22 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:57.087517 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f56d9a75-b132-49c8-9d5c-29e5c028fe22 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:57.115852 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f56d9a75-b132-49c8-9d5c-29e5c028fe22 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/os-volume_attachments/c7f2fe9d-4c86-4b4e-b3af-8a8b98d5aec5" status: 200 len: 194 microversion: 2.1 time: 0.041787 Jan 19 16:12:57.116358 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 632/1340] 10.222.0.58 () {58 vars in 1412 bytes} [Wed Jan 19 16:12:57 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/os-volume_attachments/c7f2fe9d-4c86-4b4e-b3af-8a8b98d5aec5 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:12:57.126746 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-cf921a87-0616-446b-9bbe-392acf6bb57d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:57.127256 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-cf921a87-0616-446b-9bbe-392acf6bb57d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:57.133105 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cf921a87-0616-446b-9bbe-392acf6bb57d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:57.133573 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cf921a87-0616-446b-9bbe-392acf6bb57d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:57.134337 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cf921a87-0616-446b-9bbe-392acf6bb57d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:57.134762 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-cf921a87-0616-446b-9bbe-392acf6bb57d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:57.210902 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.objects.instance [None req-cf921a87-0616-446b-9bbe-392acf6bb57d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lazy-loading 'services' on Instance uuid 20829277-9045-4a21-b255-9607610cf3f0 {{(pid=128876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:12:57.431279 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-cf921a87-0616-446b-9bbe-392acf6bb57d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "DELETE /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/os-volume_attachments/c7f2fe9d-4c86-4b4e-b3af-8a8b98d5aec5" status: 202 len: 0 microversion: 2.1 time: 0.308244 Jan 19 16:12:57.431793 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 709/1341] 10.222.0.58 () {58 vars in 1415 bytes} [Wed Jan 19 16:12:57 2022] DELETE /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/os-volume_attachments/c7f2fe9d-4c86-4b4e-b3af-8a8b98d5aec5 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:12:59.593393 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-3f675ec2-9837-4343-8102-f3542bb0a591 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:59.593899 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-3f675ec2-9837-4343-8102-f3542bb0a591 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:59.600084 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3f675ec2-9837-4343-8102-f3542bb0a591 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:59.600523 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3f675ec2-9837-4343-8102-f3542bb0a591 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:59.601285 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3f675ec2-9837-4343-8102-f3542bb0a591 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:59.601710 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3f675ec2-9837-4343-8102-f3542bb0a591 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:59.629669 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-3f675ec2-9837-4343-8102-f3542bb0a591 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/os-volume_attachments/579b407b-b678-4893-b037-2160dbe53b3f" status: 200 len: 194 microversion: 2.1 time: 0.040622 Jan 19 16:12:59.630271 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 633/1342] 10.222.0.58 () {58 vars in 1412 bytes} [Wed Jan 19 16:12:59 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/os-volume_attachments/579b407b-b678-4893-b037-2160dbe53b3f => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:12:59.641365 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d152e636-a5f3-42ad-b104-ea09b837d581 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:12:59.641937 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-d152e636-a5f3-42ad-b104-ea09b837d581 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:12:59.647940 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d152e636-a5f3-42ad-b104-ea09b837d581 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:59.648383 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d152e636-a5f3-42ad-b104-ea09b837d581 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:59.649157 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d152e636-a5f3-42ad-b104-ea09b837d581 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:12:59.649591 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d152e636-a5f3-42ad-b104-ea09b837d581 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:12:59.725941 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.objects.instance [None req-d152e636-a5f3-42ad-b104-ea09b837d581 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lazy-loading 'services' on Instance uuid 20829277-9045-4a21-b255-9607610cf3f0 {{(pid=128876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:12:59.959619 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-d152e636-a5f3-42ad-b104-ea09b837d581 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "DELETE /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/os-volume_attachments/579b407b-b678-4893-b037-2160dbe53b3f" status: 202 len: 0 microversion: 2.1 time: 0.323125 Jan 19 16:12:59.960218 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 710/1343] 10.222.0.58 () {58 vars in 1415 bytes} [Wed Jan 19 16:12:59 2022] DELETE /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/os-volume_attachments/579b407b-b678-4893-b037-2160dbe53b3f => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:13:01.113552 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-888cb368-8ab3-4d7c-8b93-4d29de551b31 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:01.114397 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-888cb368-8ab3-4d7c-8b93-4d29de551b31 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:13:01.120872 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-888cb368-8ab3-4d7c-8b93-4d29de551b31 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:01.121537 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-888cb368-8ab3-4d7c-8b93-4d29de551b31 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:01.122085 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-888cb368-8ab3-4d7c-8b93-4d29de551b31 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:01.122517 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-888cb368-8ab3-4d7c-8b93-4d29de551b31 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:01.154354 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-888cb368-8ab3-4d7c-8b93-4d29de551b31 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044433 Jan 19 16:13:01.155115 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 634/1344] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:13:01 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:13:01.284045 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b0f44d7e-f865-4e2c-bf93-e56c4d166a32 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:01.286645 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b0f44d7e-f865-4e2c-bf93-e56c4d166a32 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:13:01.291740 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b0f44d7e-f865-4e2c-bf93-e56c4d166a32 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:01.292222 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b0f44d7e-f865-4e2c-bf93-e56c4d166a32 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:01.293020 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b0f44d7e-f865-4e2c-bf93-e56c4d166a32 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:01.293450 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b0f44d7e-f865-4e2c-bf93-e56c4d166a32 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:01.324694 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b0f44d7e-f865-4e2c-bf93-e56c4d166a32 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046842 Jan 19 16:13:01.325289 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 711/1345] 10.222.0.58 () {58 vars in 1301 bytes} [Wed Jan 19 16:13:01 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:13:01.384706 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-9bb6a5fe-7359-4113-8bf4-2a384e11f90d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:01.385185 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-9bb6a5fe-7359-4113-8bf4-2a384e11f90d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:13:01.391406 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9bb6a5fe-7359-4113-8bf4-2a384e11f90d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:01.391856 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9bb6a5fe-7359-4113-8bf4-2a384e11f90d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:01.392640 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9bb6a5fe-7359-4113-8bf4-2a384e11f90d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:01.393074 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-9bb6a5fe-7359-4113-8bf4-2a384e11f90d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:01.419676 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-9bb6a5fe-7359-4113-8bf4-2a384e11f90d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Going to try to terminate instance {{(pid=128875) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:13:01.773788 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-9bb6a5fe-7359-4113-8bf4-2a384e11f90d tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "DELETE /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0" status: 204 len: 0 microversion: 2.1 time: 0.392566 Jan 19 16:13:01.774616 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 635/1346] 10.222.0.58 () {58 vars in 1238 bytes} [Wed Jan 19 16:13:01 2022] DELETE /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:13:01.783678 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f49b3510-303f-445a-9082-4fabc02c5da0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:01.784299 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f49b3510-303f-445a-9082-4fabc02c5da0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:13:01.790184 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f49b3510-303f-445a-9082-4fabc02c5da0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:01.790625 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f49b3510-303f-445a-9082-4fabc02c5da0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:01.791439 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f49b3510-303f-445a-9082-4fabc02c5da0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:01.791870 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f49b3510-303f-445a-9082-4fabc02c5da0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:01.923861 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f49b3510-303f-445a-9082-4fabc02c5da0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:13:01.931646 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f49b3510-303f-445a-9082-4fabc02c5da0 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0" status: 200 len: 1671 microversion: 2.1 time: 0.152144 Jan 19 16:13:01.932223 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 712/1347] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:13:01 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:13:02.949592 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f4593a2a-a4c9-4314-86bf-a2f0d9d66223 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:02.950198 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-f4593a2a-a4c9-4314-86bf-a2f0d9d66223 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:13:02.957632 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f4593a2a-a4c9-4314-86bf-a2f0d9d66223 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:02.958076 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f4593a2a-a4c9-4314-86bf-a2f0d9d66223 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:02.958871 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f4593a2a-a4c9-4314-86bf-a2f0d9d66223 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:02.959328 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f4593a2a-a4c9-4314-86bf-a2f0d9d66223 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:03.093219 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-f4593a2a-a4c9-4314-86bf-a2f0d9d66223 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:13:03.100941 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f4593a2a-a4c9-4314-86bf-a2f0d9d66223 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0" status: 200 len: 1671 microversion: 2.1 time: 0.155545 Jan 19 16:13:03.101526 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 636/1348] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:13:02 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:13:04.118328 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-928d813f-f2e6-4630-885d-3acda6d8f7a7 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:04.119079 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-928d813f-f2e6-4630-885d-3acda6d8f7a7 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:13:04.126231 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-928d813f-f2e6-4630-885d-3acda6d8f7a7 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:04.126670 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-928d813f-f2e6-4630-885d-3acda6d8f7a7 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:04.127493 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-928d813f-f2e6-4630-885d-3acda6d8f7a7 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:04.127924 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-928d813f-f2e6-4630-885d-3acda6d8f7a7 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:04.259240 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-928d813f-f2e6-4630-885d-3acda6d8f7a7 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:13:04.267002 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-928d813f-f2e6-4630-885d-3acda6d8f7a7 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0" status: 200 len: 1671 microversion: 2.1 time: 0.152320 Jan 19 16:13:04.267573 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 713/1349] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:13:04 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:13:05.252564 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-08536612-1aab-471c-abda-7756f0f2bef1 req-65a69b54-eb80-46fa-b5f7-96db4602aa09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20829277-9045-4a21-b255-9607610cf3f0", "name": "network-vif-deleted", "tag": "a82ac16e-2982-490d-919b-a97fa8404828"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:13:05.254295 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:13:05.254295 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:13:05.262211 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-08536612-1aab-471c-abda-7756f0f2bef1 req-65a69b54-eb80-46fa-b5f7-96db4602aa09 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:05.262640 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-08536612-1aab-471c-abda-7756f0f2bef1 req-65a69b54-eb80-46fa-b5f7-96db4602aa09 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:05.275345 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-08536612-1aab-471c-abda-7756f0f2bef1 req-65a69b54-eb80-46fa-b5f7-96db4602aa09 service nova] Creating event network-vif-deleted:a82ac16e-2982-490d-919b-a97fa8404828 for instance 20829277-9045-4a21-b255-9607610cf3f0 on hv-cinder-82002 Jan 19 16:13:05.281087 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-08536612-1aab-471c-abda-7756f0f2bef1 req-65a69b54-eb80-46fa-b5f7-96db4602aa09 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096498 Jan 19 16:13:05.282354 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 637/1350] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:13:05.285447 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c5281ad5-34a2-4e37-a006-c0541fe79fc2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:05.286031 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c5281ad5-34a2-4e37-a006-c0541fe79fc2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:13:05.292453 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c5281ad5-34a2-4e37-a006-c0541fe79fc2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:05.293222 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c5281ad5-34a2-4e37-a006-c0541fe79fc2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:05.294304 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c5281ad5-34a2-4e37-a006-c0541fe79fc2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:05.294746 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c5281ad5-34a2-4e37-a006-c0541fe79fc2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:05.374573 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c5281ad5-34a2-4e37-a006-c0541fe79fc2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7085f779daa4cd6acf0b38a942d9c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803e4baba323417f977814e1d7250779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:13:05.383227 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c5281ad5-34a2-4e37-a006-c0541fe79fc2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0" status: 200 len: 1603 microversion: 2.1 time: 0.102936 Jan 19 16:13:05.383808 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 714/1351] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:13:05 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0 => generated 1603 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:13:06.402371 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-35c7ec70-547d-4763-a7cd-061815073d2f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:06.402993 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-35c7ec70-547d-4763-a7cd-061815073d2f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:13:06.409280 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-35c7ec70-547d-4763-a7cd-061815073d2f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:06.409716 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-35c7ec70-547d-4763-a7cd-061815073d2f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:06.410740 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-35c7ec70-547d-4763-a7cd-061815073d2f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:06.411217 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-35c7ec70-547d-4763-a7cd-061815073d2f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:06.425174 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.wsgi [None req-35c7ec70-547d-4763-a7cd-061815073d2f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] HTTP exception thrown: Instance 20829277-9045-4a21-b255-9607610cf3f0 could not be found. Jan 19 16:13:06.425756 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-35c7ec70-547d-4763-a7cd-061815073d2f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Returning 404 to user: Instance 20829277-9045-4a21-b255-9607610cf3f0 could not be found. {{(pid=128875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:13:06.426581 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-35c7ec70-547d-4763-a7cd-061815073d2f tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0" status: 404 len: 111 microversion: 2.1 time: 0.028958 Jan 19 16:13:06.427162 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 638/1352] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:13:06 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:13:06.435692 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-e30250c2-87d4-4438-bbf3-3d25c0fcac3b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '.version_select at 0x7feff5e1d820>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:06.523409 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-e30250c2-87d4-4438-bbf3-3d25c0fcac3b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-469704561" status: 202 len: 0 microversion: 2.1 time: 0.091258 Jan 19 16:13:06.523989 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 715/1353] 10.222.0.58 () {58 vars in 1217 bytes} [Wed Jan 19 16:13:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-469704561 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:13:09.841393 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-4cf5cb00-c0f3-491c-b5d0-3f22cd9b2a6b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:09.841393 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-4cf5cb00-c0f3-491c-b5d0-3f22cd9b2a6b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:13:09.843749 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4cf5cb00-c0f3-491c-b5d0-3f22cd9b2a6b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:09.844202 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4cf5cb00-c0f3-491c-b5d0-3f22cd9b2a6b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:09.844991 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4cf5cb00-c0f3-491c-b5d0-3f22cd9b2a6b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:09.845421 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4cf5cb00-c0f3-491c-b5d0-3f22cd9b2a6b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:09.863833 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.wsgi [None req-4cf5cb00-c0f3-491c-b5d0-3f22cd9b2a6b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] HTTP exception thrown: Instance 20829277-9045-4a21-b255-9607610cf3f0 could not be found. Jan 19 16:13:09.863833 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-4cf5cb00-c0f3-491c-b5d0-3f22cd9b2a6b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Returning 404 to user: Instance 20829277-9045-4a21-b255-9607610cf3f0 could not be found. {{(pid=128875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:13:09.863833 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-4cf5cb00-c0f3-491c-b5d0-3f22cd9b2a6b tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "DELETE /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0" status: 404 len: 111 microversion: 2.1 time: 0.028416 Jan 19 16:13:09.863833 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 639/1354] 10.222.0.58 () {58 vars in 1238 bytes} [Wed Jan 19 16:13:09 2022] DELETE /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:13:09.870895 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-6f44bd18-7d68-420a-b980-0a23578bbceb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:09.871691 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-6f44bd18-7d68-420a-b980-0a23578bbceb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: 20829277-9045-4a21-b255-9607610cf3f0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:13:09.879170 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6f44bd18-7d68-420a-b980-0a23578bbceb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:09.879625 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6f44bd18-7d68-420a-b980-0a23578bbceb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:09.880434 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6f44bd18-7d68-420a-b980-0a23578bbceb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:09.880871 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6f44bd18-7d68-420a-b980-0a23578bbceb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:09.895869 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.wsgi [None req-6f44bd18-7d68-420a-b980-0a23578bbceb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] HTTP exception thrown: Instance 20829277-9045-4a21-b255-9607610cf3f0 could not be found. Jan 19 16:13:09.896538 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-6f44bd18-7d68-420a-b980-0a23578bbceb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Returning 404 to user: Instance 20829277-9045-4a21-b255-9607610cf3f0 could not be found. {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:13:09.897510 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-6f44bd18-7d68-420a-b980-0a23578bbceb tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0" status: 404 len: 111 microversion: 2.1 time: 0.030403 Jan 19 16:13:09.898137 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 716/1355] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:13:09 2022] GET /compute/v2.1/servers/20829277-9045-4a21-b255-9607610cf3f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:13:11.126156 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-5cdb7d9a-8828-48fe-8556-b058bd4cc419 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:11.126774 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-5cdb7d9a-8828-48fe-8556-b058bd4cc419 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:13:11.134410 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5cdb7d9a-8828-48fe-8556-b058bd4cc419 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:11.134856 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5cdb7d9a-8828-48fe-8556-b058bd4cc419 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:11.135680 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5cdb7d9a-8828-48fe-8556-b058bd4cc419 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:11.136114 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5cdb7d9a-8828-48fe-8556-b058bd4cc419 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:11.151042 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.wsgi [None req-5cdb7d9a-8828-48fe-8556-b058bd4cc419 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] HTTP exception thrown: Instance a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a could not be found. Jan 19 16:13:11.151643 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-5cdb7d9a-8828-48fe-8556-b058bd4cc419 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Returning 404 to user: Instance a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a could not be found. {{(pid=128875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:13:11.152497 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-5cdb7d9a-8828-48fe-8556-b058bd4cc419 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 404 len: 111 microversion: 2.1 time: 0.030609 Jan 19 16:13:11.153048 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 640/1356] 10.222.0.58 () {58 vars in 1238 bytes} [Wed Jan 19 16:13:11 2022] DELETE /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:13:11.161196 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-de3dce2b-ff7b-448e-8ce0-8e44850e05f2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:11.161803 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-de3dce2b-ff7b-448e-8ce0-8e44850e05f2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] [instance: a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:13:11.168276 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-de3dce2b-ff7b-448e-8ce0-8e44850e05f2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:11.168710 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-de3dce2b-ff7b-448e-8ce0-8e44850e05f2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:11.169497 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-de3dce2b-ff7b-448e-8ce0-8e44850e05f2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:11.169931 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-de3dce2b-ff7b-448e-8ce0-8e44850e05f2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:11.183908 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.wsgi [None req-de3dce2b-ff7b-448e-8ce0-8e44850e05f2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] HTTP exception thrown: Instance a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a could not be found. Jan 19 16:13:11.184496 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-de3dce2b-ff7b-448e-8ce0-8e44850e05f2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] Returning 404 to user: Instance a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a could not be found. {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:13:11.185322 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-de3dce2b-ff7b-448e-8ce0-8e44850e05f2 tempest-AttachVolumeTestJSON-454628825 tempest-AttachVolumeTestJSON-454628825-project] 10.222.0.58 "GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a" status: 404 len: 111 microversion: 2.1 time: 0.027900 Jan 19 16:13:11.185867 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 717/1357] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:13:11 2022] GET /compute/v2.1/servers/a45dd0c0-b83c-43a1-9ea0-e2d4f5fd860a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:13:39.156250 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-efb1ef44-20a4-4ddd-a693-9bb58ad0f03f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:39.157782 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-efb1ef44-20a4-4ddd-a693-9bb58ad0f03f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:13:39.164693 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-efb1ef44-20a4-4ddd-a693-9bb58ad0f03f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:39.167749 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-efb1ef44-20a4-4ddd-a693-9bb58ad0f03f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:39.167749 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-efb1ef44-20a4-4ddd-a693-9bb58ad0f03f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:39.167749 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-efb1ef44-20a4-4ddd-a693-9bb58ad0f03f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:39.197310 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-efb1ef44-20a4-4ddd-a693-9bb58ad0f03f tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045299 Jan 19 16:13:39.197885 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 641/1358] 10.222.0.58 () {60 vars in 1342 bytes} [Wed Jan 19 16:13:39 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:13:39.259278 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ec00690e-92f6-4e3f-b89b-9bee03274918 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:39.259864 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ec00690e-92f6-4e3f-b89b-9bee03274918 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:13:39.265874 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ec00690e-92f6-4e3f-b89b-9bee03274918 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:39.266323 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ec00690e-92f6-4e3f-b89b-9bee03274918 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:39.267125 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ec00690e-92f6-4e3f-b89b-9bee03274918 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:39.267553 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ec00690e-92f6-4e3f-b89b-9bee03274918 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:39.293398 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ec00690e-92f6-4e3f-b89b-9bee03274918 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Going to try to terminate instance {{(pid=128876) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:13:39.588063 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ec00690e-92f6-4e3f-b89b-9bee03274918 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 204 len: 0 microversion: 2.20 time: 0.332093 Jan 19 16:13:39.588580 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 718/1359] 10.222.0.58 () {60 vars in 1279 bytes} [Wed Jan 19 16:13:39 2022] DELETE /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 19 16:13:39.597069 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-eed53b24-4581-4213-bcdb-f1493b7ef070 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:39.597727 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-eed53b24-4581-4213-bcdb-f1493b7ef070 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:13:39.603655 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-eed53b24-4581-4213-bcdb-f1493b7ef070 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:39.604111 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-eed53b24-4581-4213-bcdb-f1493b7ef070 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:39.604921 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-eed53b24-4581-4213-bcdb-f1493b7ef070 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:39.605348 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-eed53b24-4581-4213-bcdb-f1493b7ef070 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:39.789841 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-eed53b24-4581-4213-bcdb-f1493b7ef070 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:13:39.797706 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-eed53b24-4581-4213-bcdb-f1493b7ef070 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:13:39.808624 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-eed53b24-4581-4213-bcdb-f1493b7ef070 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:13:39.808624 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-eed53b24-4581-4213-bcdb-f1493b7ef070 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1723 microversion: 2.20 time: 0.207600 Jan 19 16:13:39.808624 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 642/1360] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:13:39 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:13:40.818844 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-84144ae8-86c6-4b3f-8116-c7d2068169df tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:40.819644 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-84144ae8-86c6-4b3f-8116-c7d2068169df tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:13:40.826465 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-84144ae8-86c6-4b3f-8116-c7d2068169df tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:40.827059 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-84144ae8-86c6-4b3f-8116-c7d2068169df tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:40.827803 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-84144ae8-86c6-4b3f-8116-c7d2068169df tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:40.828249 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-84144ae8-86c6-4b3f-8116-c7d2068169df tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:40.969125 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-84144ae8-86c6-4b3f-8116-c7d2068169df tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:13:40.977889 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-84144ae8-86c6-4b3f-8116-c7d2068169df tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:13:40.982028 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-84144ae8-86c6-4b3f-8116-c7d2068169df tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:13:40.982028 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-84144ae8-86c6-4b3f-8116-c7d2068169df tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1723 microversion: 2.20 time: 0.166764 Jan 19 16:13:40.982028 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 719/1361] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:13:40 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:13:41.998695 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ca6a59a8-7d7a-4f07-99fd-d87ca2411eb5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:42.007409 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-ca6a59a8-7d7a-4f07-99fd-d87ca2411eb5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:13:42.013992 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ca6a59a8-7d7a-4f07-99fd-d87ca2411eb5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:42.014664 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ca6a59a8-7d7a-4f07-99fd-d87ca2411eb5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:42.015641 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ca6a59a8-7d7a-4f07-99fd-d87ca2411eb5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:42.016236 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ca6a59a8-7d7a-4f07-99fd-d87ca2411eb5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:42.077383 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-1546ac71-54f5-42d7-a514-bef9bb5697ae req-86ff23fc-17f4-442a-b18a-ed1bd863bca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c1319b6-bda0-474e-bf40-08f9106fa169", "name": "network-vif-deleted", "tag": "a7371518-3a83-43f3-a73a-17f850f9c369"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:13:42.079036 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:13:42.079036 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:13:42.088189 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-1546ac71-54f5-42d7-a514-bef9bb5697ae req-86ff23fc-17f4-442a-b18a-ed1bd863bca4 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:42.088627 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-1546ac71-54f5-42d7-a514-bef9bb5697ae req-86ff23fc-17f4-442a-b18a-ed1bd863bca4 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:42.100581 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ca6a59a8-7d7a-4f07-99fd-d87ca2411eb5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:13:42.105139 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-1546ac71-54f5-42d7-a514-bef9bb5697ae req-86ff23fc-17f4-442a-b18a-ed1bd863bca4 service nova] Creating event network-vif-deleted:a7371518-3a83-43f3-a73a-17f850f9c369 for instance 9c1319b6-bda0-474e-bf40-08f9106fa169 on hv-cinder-82002 Jan 19 16:13:42.105335 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ca6a59a8-7d7a-4f07-99fd-d87ca2411eb5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:13:42.106737 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ca6a59a8-7d7a-4f07-99fd-d87ca2411eb5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9abf8deacfc4edbb0a5585ea1fc7861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349fd4b6edd347a09b8d1ded2f25a2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:13:42.108261 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-ca6a59a8-7d7a-4f07-99fd-d87ca2411eb5 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 200 len: 1655 microversion: 2.20 time: 0.113202 Jan 19 16:13:42.111433 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-1546ac71-54f5-42d7-a514-bef9bb5697ae req-86ff23fc-17f4-442a-b18a-ed1bd863bca4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037501 Jan 19 16:13:42.116264 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 720/1362] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:13:42.120396 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 643/1363] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:13:41 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 1655 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:13:43.129666 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ee8f6229-451f-4b55-a88e-7812f31074e7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:43.130360 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-ee8f6229-451f-4b55-a88e-7812f31074e7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:13:43.136663 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ee8f6229-451f-4b55-a88e-7812f31074e7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:43.137096 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ee8f6229-451f-4b55-a88e-7812f31074e7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:43.137869 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ee8f6229-451f-4b55-a88e-7812f31074e7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:43.138341 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-ee8f6229-451f-4b55-a88e-7812f31074e7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:43.151866 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.wsgi [None req-ee8f6229-451f-4b55-a88e-7812f31074e7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] HTTP exception thrown: Instance 9c1319b6-bda0-474e-bf40-08f9106fa169 could not be found. Jan 19 16:13:43.152448 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-ee8f6229-451f-4b55-a88e-7812f31074e7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Returning 404 to user: Instance 9c1319b6-bda0-474e-bf40-08f9106fa169 could not be found. {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:13:43.153259 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-ee8f6229-451f-4b55-a88e-7812f31074e7 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 404 len: 111 microversion: 2.20 time: 0.028731 Jan 19 16:13:43.153801 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 721/1364] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:13:43 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:13:43.161919 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-9bcb2b8f-aa51-4ab5-a6ff-64fa70068483 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '.version_select at 0x7feff52fad30>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:43.297302 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-9bcb2b8f-aa51-4ab5-a6ff-64fa70068483 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-218475517" status: 204 len: 0 microversion: 2.20 time: 0.138958 Jan 19 16:13:43.297882 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 644/1365] 10.222.0.58 () {60 vars in 1258 bytes} [Wed Jan 19 16:13:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-218475517 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 19 16:13:45.462362 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a73824a8-b42f-4fe2-b2e3-c16b4e28451a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:45.462837 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a73824a8-b42f-4fe2-b2e3-c16b4e28451a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:13:45.469114 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a73824a8-b42f-4fe2-b2e3-c16b4e28451a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:45.469552 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a73824a8-b42f-4fe2-b2e3-c16b4e28451a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:45.470322 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a73824a8-b42f-4fe2-b2e3-c16b4e28451a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:45.470752 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a73824a8-b42f-4fe2-b2e3-c16b4e28451a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:45.483964 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.wsgi [None req-a73824a8-b42f-4fe2-b2e3-c16b4e28451a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] HTTP exception thrown: Instance 9c1319b6-bda0-474e-bf40-08f9106fa169 could not be found. Jan 19 16:13:45.484474 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a73824a8-b42f-4fe2-b2e3-c16b4e28451a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Returning 404 to user: Instance 9c1319b6-bda0-474e-bf40-08f9106fa169 could not be found. {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:13:45.485284 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a73824a8-b42f-4fe2-b2e3-c16b4e28451a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 404 len: 111 microversion: 2.20 time: 0.026756 Jan 19 16:13:45.485809 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 722/1366] 10.222.0.58 () {60 vars in 1279 bytes} [Wed Jan 19 16:13:45 2022] DELETE /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:13:45.494150 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-fccb619a-440f-4685-9b1b-c121b8651cd1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:45.494853 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-fccb619a-440f-4685-9b1b-c121b8651cd1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 9c1319b6-bda0-474e-bf40-08f9106fa169] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:13:45.501302 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fccb619a-440f-4685-9b1b-c121b8651cd1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:45.501736 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fccb619a-440f-4685-9b1b-c121b8651cd1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:45.502515 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fccb619a-440f-4685-9b1b-c121b8651cd1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:45.502931 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-fccb619a-440f-4685-9b1b-c121b8651cd1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:45.516309 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.wsgi [None req-fccb619a-440f-4685-9b1b-c121b8651cd1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] HTTP exception thrown: Instance 9c1319b6-bda0-474e-bf40-08f9106fa169 could not be found. Jan 19 16:13:45.516882 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-fccb619a-440f-4685-9b1b-c121b8651cd1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Returning 404 to user: Instance 9c1319b6-bda0-474e-bf40-08f9106fa169 could not be found. {{(pid=128875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:13:45.517718 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-fccb619a-440f-4685-9b1b-c121b8651cd1 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169" status: 404 len: 111 microversion: 2.20 time: 0.027755 Jan 19 16:13:45.518233 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 645/1367] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:13:45 2022] GET /compute/v2.1/servers/9c1319b6-bda0-474e-bf40-08f9106fa169 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:13:46.779082 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-4b38788a-4dee-400f-9d21-dc23770f920a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:46.779552 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-4b38788a-4dee-400f-9d21-dc23770f920a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:13:46.786327 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4b38788a-4dee-400f-9d21-dc23770f920a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:46.786771 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4b38788a-4dee-400f-9d21-dc23770f920a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:46.787569 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4b38788a-4dee-400f-9d21-dc23770f920a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:46.787990 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4b38788a-4dee-400f-9d21-dc23770f920a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:46.800935 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.wsgi [None req-4b38788a-4dee-400f-9d21-dc23770f920a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] HTTP exception thrown: Instance 02ba601a-94e7-486f-9d1b-7418ae534f4f could not be found. Jan 19 16:13:46.801504 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-4b38788a-4dee-400f-9d21-dc23770f920a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Returning 404 to user: Instance 02ba601a-94e7-486f-9d1b-7418ae534f4f could not be found. {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:13:46.802306 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-4b38788a-4dee-400f-9d21-dc23770f920a tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "DELETE /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 404 len: 111 microversion: 2.20 time: 0.026973 Jan 19 16:13:46.802950 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 723/1368] 10.222.0.58 () {60 vars in 1279 bytes} [Wed Jan 19 16:13:46 2022] DELETE /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:13:46.811108 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-472bc8db-708b-4e2d-8891-4e89de4d2144 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:46.811721 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-472bc8db-708b-4e2d-8891-4e89de4d2144 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] [instance: 02ba601a-94e7-486f-9d1b-7418ae534f4f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:13:46.818536 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-472bc8db-708b-4e2d-8891-4e89de4d2144 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:46.819000 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-472bc8db-708b-4e2d-8891-4e89de4d2144 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:46.819801 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-472bc8db-708b-4e2d-8891-4e89de4d2144 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:13:46.820256 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-472bc8db-708b-4e2d-8891-4e89de4d2144 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:13:46.833873 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.wsgi [None req-472bc8db-708b-4e2d-8891-4e89de4d2144 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] HTTP exception thrown: Instance 02ba601a-94e7-486f-9d1b-7418ae534f4f could not be found. Jan 19 16:13:46.834445 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-472bc8db-708b-4e2d-8891-4e89de4d2144 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] Returning 404 to user: Instance 02ba601a-94e7-486f-9d1b-7418ae534f4f could not be found. {{(pid=128875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:13:46.835293 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-472bc8db-708b-4e2d-8891-4e89de4d2144 tempest-AttachVolumeShelveTestJSON-896423704 tempest-AttachVolumeShelveTestJSON-896423704-project] 10.222.0.58 "GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f" status: 404 len: 111 microversion: 2.20 time: 0.028038 Jan 19 16:13:46.835828 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 646/1369] 10.222.0.58 () {60 vars in 1276 bytes} [Wed Jan 19 16:13:46 2022] GET /compute/v2.1/servers/02ba601a-94e7-486f-9d1b-7418ae534f4f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 19 16:13:52.982998 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-cf6571ea-155a-430c-9514-86c8d1224eca tempest-VolumesNegativeTest-1449371918 tempest-VolumesNegativeTest-1449371918-project] Action: 'create', calling method: .version_select at 0x7feff532c550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1610836423", "metadata": {"Type": "work"}}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:13:52.984438 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-cf6571ea-155a-430c-9514-86c8d1224eca tempest-VolumesNegativeTest-1449371918 tempest-VolumesNegativeTest-1449371918-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:13:52.985303 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-cf6571ea-155a-430c-9514-86c8d1224eca tempest-VolumesNegativeTest-1449371918 tempest-VolumesNegativeTest-1449371918-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.173335 Jan 19 16:13:52.985833 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 724/1370] 10.222.0.58 () {60 vars in 1155 bytes} [Wed Jan 19 16:13:52 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:13:52.995278 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e3373486-15e8-4c65-9136-fda16fa42ee8 tempest-VolumesNegativeTest-1449371918 tempest-VolumesNegativeTest-1449371918-project] Action: 'create', calling method: .version_select at 0x7feff519fca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-933154196", "metadata": {"Type": "work"}}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:13:52.996669 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e3373486-15e8-4c65-9136-fda16fa42ee8 tempest-VolumesNegativeTest-1449371918 tempest-VolumesNegativeTest-1449371918-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:13:52.997457 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e3373486-15e8-4c65-9136-fda16fa42ee8 tempest-VolumesNegativeTest-1449371918 tempest-VolumesNegativeTest-1449371918-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.005882 Jan 19 16:13:52.997963 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 647/1371] 10.222.0.58 () {60 vars in 1155 bytes} [Wed Jan 19 16:13:52 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:13:53.006374 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-2f95c178-fa99-4492-8b20-9dcab54f9791 tempest-VolumesNegativeTest-1449371918 tempest-VolumesNegativeTest-1449371918-project] Action: 'create', calling method: .version_select at 0x7feff517eaf0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1219571511", "metadata": {"Type": "work"}}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:13:53.008356 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-2f95c178-fa99-4492-8b20-9dcab54f9791 tempest-VolumesNegativeTest-1449371918 tempest-VolumesNegativeTest-1449371918-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:13:53.009151 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-2f95c178-fa99-4492-8b20-9dcab54f9791 tempest-VolumesNegativeTest-1449371918 tempest-VolumesNegativeTest-1449371918-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006307 Jan 19 16:13:53.009660 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 725/1372] 10.222.0.58 () {60 vars in 1155 bytes} [Wed Jan 19 16:13:53 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:13:53.018173 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-649eee09-b90f-4d05-8cff-597808c0caa3 tempest-VolumesNegativeTest-1449371918 tempest-VolumesNegativeTest-1449371918-project] Calling method '.version_select at 0x7feff5408a60>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:53.045782 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.wsgi [None req-649eee09-b90f-4d05-8cff-597808c0caa3 tempest-VolumesNegativeTest-1449371918 tempest-VolumesNegativeTest-1449371918-project] HTTP exception thrown: Volume tempest-invalid-1229969531 could not be found. Jan 19 16:13:53.046366 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-649eee09-b90f-4d05-8cff-597808c0caa3 tempest-VolumesNegativeTest-1449371918 tempest-VolumesNegativeTest-1449371918-project] Returning 404 to user: Volume tempest-invalid-1229969531 could not be found. {{(pid=128875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:13:53.047233 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-649eee09-b90f-4d05-8cff-597808c0caa3 tempest-VolumesNegativeTest-1449371918 tempest-VolumesNegativeTest-1449371918-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1229969531" status: 404 len: 99 microversion: 2.1 time: 0.033011 Jan 19 16:13:53.047783 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 648/1373] 10.222.0.58 () {58 vars in 1217 bytes} [Wed Jan 19 16:13:53 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1229969531 => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 19 16:13:53.057474 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-082bef9b-8599-460a-be14-055164b188b2 tempest-VolumesNegativeTest-1449371918 tempest-VolumesNegativeTest-1449371918-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003886 Jan 19 16:13:53.057977 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 726/1374] 10.222.0.58 () {58 vars in 1139 bytes} [Wed Jan 19 16:13:53 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 19 16:13:53.066144 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-0277a2b3-ac95-4642-a024-a37b1f97ab2f tempest-VolumesNegativeTest-1449371918 tempest-VolumesNegativeTest-1449371918-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003539 Jan 19 16:13:53.066705 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 649/1375] 10.222.0.58 () {58 vars in 1136 bytes} [Wed Jan 19 16:13:53 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 19 16:13:53.076832 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-7d0a834a-0d09-4ecc-883e-279f6281b66b tempest-VolumesNegativeTest-1449371918 tempest-VolumesNegativeTest-1449371918-project] Calling method '.version_select at 0x7feff53e1550>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:53.102964 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.wsgi [None req-7d0a834a-0d09-4ecc-883e-279f6281b66b tempest-VolumesNegativeTest-1449371918 tempest-VolumesNegativeTest-1449371918-project] HTTP exception thrown: Volume c2881d2d-88d9-4733-bd43-52f4fbbb0556 could not be found. Jan 19 16:13:53.103628 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-7d0a834a-0d09-4ecc-883e-279f6281b66b tempest-VolumesNegativeTest-1449371918 tempest-VolumesNegativeTest-1449371918-project] Returning 404 to user: Volume c2881d2d-88d9-4733-bd43-52f4fbbb0556 could not be found. {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:13:53.104478 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-7d0a834a-0d09-4ecc-883e-279f6281b66b tempest-VolumesNegativeTest-1449371918 tempest-VolumesNegativeTest-1449371918-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/c2881d2d-88d9-4733-bd43-52f4fbbb0556" status: 404 len: 109 microversion: 2.1 time: 0.031373 Jan 19 16:13:53.105010 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 727/1376] 10.222.0.58 () {58 vars in 1247 bytes} [Wed Jan 19 16:13:53 2022] DELETE /compute/v2.1/os-volumes/c2881d2d-88d9-4733-bd43-52f4fbbb0556 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:13:53.114390 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-dbfdaa64-ac09-4bb7-9aea-59e10fd13f76 tempest-VolumesNegativeTest-1449371918 tempest-VolumesNegativeTest-1449371918-project] Calling method '.version_select at 0x7feff54f30d0>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:13:53.140176 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.wsgi [None req-dbfdaa64-ac09-4bb7-9aea-59e10fd13f76 tempest-VolumesNegativeTest-1449371918 tempest-VolumesNegativeTest-1449371918-project] HTTP exception thrown: Volume fcdee3e2-fce7-4e61-8b95-85b0d21bc819 could not be found. Jan 19 16:13:53.140770 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-dbfdaa64-ac09-4bb7-9aea-59e10fd13f76 tempest-VolumesNegativeTest-1449371918 tempest-VolumesNegativeTest-1449371918-project] Returning 404 to user: Volume fcdee3e2-fce7-4e61-8b95-85b0d21bc819 could not be found. {{(pid=128875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:13:53.141598 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-dbfdaa64-ac09-4bb7-9aea-59e10fd13f76 tempest-VolumesNegativeTest-1449371918 tempest-VolumesNegativeTest-1449371918-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/fcdee3e2-fce7-4e61-8b95-85b0d21bc819" status: 404 len: 109 microversion: 2.1 time: 0.031509 Jan 19 16:13:53.142148 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 650/1377] 10.222.0.58 () {58 vars in 1244 bytes} [Wed Jan 19 16:13:53 2022] GET /compute/v2.1/os-volumes/fcdee3e2-fce7-4e61-8b95-85b0d21bc819 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:14:08.919924 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-20809b3f-46bd-4145-8b42-c0bb784a41e2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:14:08.919924 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-20809b3f-46bd-4145-8b42-c0bb784a41e2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:14:08.925222 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-20809b3f-46bd-4145-8b42-c0bb784a41e2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:08.925668 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-20809b3f-46bd-4145-8b42-c0bb784a41e2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:08.926256 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-1991ff41-df4e-4c44-8e0d-040ee6ee6d14 req-e88efff0-91f1-4ed7-a542-e6f5638581f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8fc83e4-334a-4135-8e9a-ffa59df1a1d0", "tag": "b2227ef0-87de-42b4-a1ba-9d3a0612b9ac"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:14:08.926737 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-20809b3f-46bd-4145-8b42-c0bb784a41e2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:08.926892 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-20809b3f-46bd-4145-8b42-c0bb784a41e2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:08.928822 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:14:08.928822 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:14:08.936380 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-1991ff41-df4e-4c44-8e0d-040ee6ee6d14 req-e88efff0-91f1-4ed7-a542-e6f5638581f4 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:08.936814 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-1991ff41-df4e-4c44-8e0d-040ee6ee6d14 req-e88efff0-91f1-4ed7-a542-e6f5638581f4 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:08.948833 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-1991ff41-df4e-4c44-8e0d-040ee6ee6d14 req-e88efff0-91f1-4ed7-a542-e6f5638581f4 service nova] Creating event network-changed:b2227ef0-87de-42b4-a1ba-9d3a0612b9ac for instance f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 on hv-cinder-82002 Jan 19 16:14:08.954731 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-20809b3f-46bd-4145-8b42-c0bb784a41e2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Going to try to terminate instance {{(pid=128876) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:14:08.955317 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-1991ff41-df4e-4c44-8e0d-040ee6ee6d14 req-e88efff0-91f1-4ed7-a542-e6f5638581f4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035252 Jan 19 16:14:08.956209 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 651/1378] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:14:09.273773 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-20809b3f-46bd-4145-8b42-c0bb784a41e2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 204 len: 0 microversion: 2.1 time: 0.360641 Jan 19 16:14:09.273773 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 728/1379] 10.222.0.58 () {58 vars in 1238 bytes} [Wed Jan 19 16:14:08 2022] DELETE /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:14:09.283136 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d5c37400-f683-4285-82ac-279df55d8584 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:14:09.283829 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d5c37400-f683-4285-82ac-279df55d8584 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:14:09.292040 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d5c37400-f683-4285-82ac-279df55d8584 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:09.294731 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d5c37400-f683-4285-82ac-279df55d8584 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:09.296253 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d5c37400-f683-4285-82ac-279df55d8584 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:09.297466 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d5c37400-f683-4285-82ac-279df55d8584 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:09.541444 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d5c37400-f683-4285-82ac-279df55d8584 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:14:09.549403 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d5c37400-f683-4285-82ac-279df55d8584 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1576 microversion: 2.1 time: 0.271003 Jan 19 16:14:09.550294 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 652/1380] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:14:09 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1576 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:14:10.567866 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c9d9fe7e-8adc-49cf-b887-0e63e7683acc tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:14:10.568655 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c9d9fe7e-8adc-49cf-b887-0e63e7683acc tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:14:10.575297 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c9d9fe7e-8adc-49cf-b887-0e63e7683acc tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:10.575758 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c9d9fe7e-8adc-49cf-b887-0e63e7683acc tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:10.576561 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c9d9fe7e-8adc-49cf-b887-0e63e7683acc tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:10.576995 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c9d9fe7e-8adc-49cf-b887-0e63e7683acc tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:10.725911 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c9d9fe7e-8adc-49cf-b887-0e63e7683acc tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:14:10.733246 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c9d9fe7e-8adc-49cf-b887-0e63e7683acc tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1458 microversion: 2.1 time: 0.169461 Jan 19 16:14:10.736940 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 729/1381] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:14:10 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1458 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:14:11.749515 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-80331a5d-79af-48a9-85e6-13ac9b27b52c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:14:11.750123 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-80331a5d-79af-48a9-85e6-13ac9b27b52c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:14:11.757107 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-80331a5d-79af-48a9-85e6-13ac9b27b52c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:11.757808 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-80331a5d-79af-48a9-85e6-13ac9b27b52c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:11.758642 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-80331a5d-79af-48a9-85e6-13ac9b27b52c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:11.759293 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-80331a5d-79af-48a9-85e6-13ac9b27b52c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:11.846874 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-80331a5d-79af-48a9-85e6-13ac9b27b52c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:14:11.856194 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-80331a5d-79af-48a9-85e6-13ac9b27b52c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1391 microversion: 2.1 time: 0.110344 Jan 19 16:14:11.859159 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-2c48e0ed-c2f2-4cc2-965f-71f336c25ed7 req-c685b0ee-6140-4e6a-be2e-8ccc94e09467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8fc83e4-334a-4135-8e9a-ffa59df1a1d0", "name": "network-vif-deleted", "tag": "b2227ef0-87de-42b4-a1ba-9d3a0612b9ac"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:14:11.860096 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:14:11.860096 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:14:11.867788 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 653/1382] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:14:11 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1391 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:14:11.867988 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-2c48e0ed-c2f2-4cc2-965f-71f336c25ed7 req-c685b0ee-6140-4e6a-be2e-8ccc94e09467 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:11.868424 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-2c48e0ed-c2f2-4cc2-965f-71f336c25ed7 req-c685b0ee-6140-4e6a-be2e-8ccc94e09467 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:11.879089 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-2c48e0ed-c2f2-4cc2-965f-71f336c25ed7 req-c685b0ee-6140-4e6a-be2e-8ccc94e09467 service nova] Creating event network-vif-deleted:b2227ef0-87de-42b4-a1ba-9d3a0612b9ac for instance f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 on hv-cinder-82002 Jan 19 16:14:11.884143 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-2c48e0ed-c2f2-4cc2-965f-71f336c25ed7 req-c685b0ee-6140-4e6a-be2e-8ccc94e09467 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029224 Jan 19 16:14:11.889854 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 730/1383] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:14:12.875505 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-17a28c56-d22b-4eb3-8401-bef3338fb83d tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:14:12.876045 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-17a28c56-d22b-4eb3-8401-bef3338fb83d tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:14:12.882335 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-17a28c56-d22b-4eb3-8401-bef3338fb83d tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:12.882772 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-17a28c56-d22b-4eb3-8401-bef3338fb83d tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:12.883578 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-17a28c56-d22b-4eb3-8401-bef3338fb83d tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:12.884030 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-17a28c56-d22b-4eb3-8401-bef3338fb83d tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:12.945869 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-17a28c56-d22b-4eb3-8401-bef3338fb83d tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:14:12.953634 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-17a28c56-d22b-4eb3-8401-bef3338fb83d tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1391 microversion: 2.1 time: 0.081838 Jan 19 16:14:12.954298 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 654/1384] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:14:12 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1391 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:14:13.972079 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-9d80b73b-82ce-4368-8a64-a7095aa82291 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:14:13.972881 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-9d80b73b-82ce-4368-8a64-a7095aa82291 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:14:13.979088 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9d80b73b-82ce-4368-8a64-a7095aa82291 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:13.979536 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9d80b73b-82ce-4368-8a64-a7095aa82291 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:13.980311 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9d80b73b-82ce-4368-8a64-a7095aa82291 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:13.980742 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-9d80b73b-82ce-4368-8a64-a7095aa82291 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:14.040830 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-9d80b73b-82ce-4368-8a64-a7095aa82291 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:14:14.048194 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-9d80b73b-82ce-4368-8a64-a7095aa82291 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1225 microversion: 2.1 time: 0.080599 Jan 19 16:14:14.048760 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 731/1385] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:14:13 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:14:15.065898 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-7a5ad57c-0b7d-4df3-8a87-8e871568346d tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:14:15.066505 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-7a5ad57c-0b7d-4df3-8a87-8e871568346d tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:14:15.073003 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7a5ad57c-0b7d-4df3-8a87-8e871568346d tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:15.073444 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7a5ad57c-0b7d-4df3-8a87-8e871568346d tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:15.074219 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7a5ad57c-0b7d-4df3-8a87-8e871568346d tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:15.074647 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7a5ad57c-0b7d-4df3-8a87-8e871568346d tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:15.390903 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-7a5ad57c-0b7d-4df3-8a87-8e871568346d tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:14:15.399702 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-7a5ad57c-0b7d-4df3-8a87-8e871568346d tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1225 microversion: 2.1 time: 0.337451 Jan 19 16:14:15.400414 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 655/1386] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:14:15 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1225 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:14:16.418775 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f51e8c48-e1cf-48c5-ba9c-44f2c9f8d2ea tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:14:16.419405 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f51e8c48-e1cf-48c5-ba9c-44f2c9f8d2ea tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:14:16.425679 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f51e8c48-e1cf-48c5-ba9c-44f2c9f8d2ea tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:16.435131 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f51e8c48-e1cf-48c5-ba9c-44f2c9f8d2ea tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:16.435131 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f51e8c48-e1cf-48c5-ba9c-44f2c9f8d2ea tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:16.435131 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f51e8c48-e1cf-48c5-ba9c-44f2c9f8d2ea tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:16.485888 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f51e8c48-e1cf-48c5-ba9c-44f2c9f8d2ea tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:14:16.493428 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f51e8c48-e1cf-48c5-ba9c-44f2c9f8d2ea tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1225 microversion: 2.1 time: 0.078292 Jan 19 16:14:16.493999 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 732/1387] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:14:16 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:14:17.510037 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f0a7ef68-3338-472d-a5a1-fd8c5cf2c4f9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:14:17.513069 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-f0a7ef68-3338-472d-a5a1-fd8c5cf2c4f9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:14:17.516903 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f0a7ef68-3338-472d-a5a1-fd8c5cf2c4f9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:17.517369 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f0a7ef68-3338-472d-a5a1-fd8c5cf2c4f9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:17.518237 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f0a7ef68-3338-472d-a5a1-fd8c5cf2c4f9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:17.518668 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f0a7ef68-3338-472d-a5a1-fd8c5cf2c4f9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:17.549797 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f0a7ef68-3338-472d-a5a1-fd8c5cf2c4f9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:17.550289 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-f0a7ef68-3338-472d-a5a1-fd8c5cf2c4f9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:17.550706 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.objects.instance [None req-f0a7ef68-3338-472d-a5a1-fd8c5cf2c4f9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lazy-loading 'fault' on Instance uuid f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 {{(pid=128875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:14:17.592185 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-f0a7ef68-3338-472d-a5a1-fd8c5cf2c4f9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:14:17.600154 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f0a7ef68-3338-472d-a5a1-fd8c5cf2c4f9 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 200 len: 1230 microversion: 2.1 time: 0.093778 Jan 19 16:14:17.607201 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 656/1388] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:14:17 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 1230 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:14:18.617083 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3cdc9566-eb4d-4867-a82c-4e9210a0672e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:14:18.617755 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3cdc9566-eb4d-4867-a82c-4e9210a0672e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: f8fc83e4-334a-4135-8e9a-ffa59df1a1d0] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:14:18.632106 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3cdc9566-eb4d-4867-a82c-4e9210a0672e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:18.632106 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3cdc9566-eb4d-4867-a82c-4e9210a0672e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:18.632106 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3cdc9566-eb4d-4867-a82c-4e9210a0672e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:18.632106 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3cdc9566-eb4d-4867-a82c-4e9210a0672e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:18.641533 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.wsgi [None req-3cdc9566-eb4d-4867-a82c-4e9210a0672e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] HTTP exception thrown: Instance f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 could not be found. Jan 19 16:14:18.642143 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3cdc9566-eb4d-4867-a82c-4e9210a0672e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Returning 404 to user: Instance f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 could not be found. {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:14:18.643149 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3cdc9566-eb4d-4867-a82c-4e9210a0672e tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0" status: 404 len: 111 microversion: 2.1 time: 0.029615 Jan 19 16:14:18.643706 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 733/1389] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:14:18 2022] GET /compute/v2.1/servers/f8fc83e4-334a-4135-8e9a-ffa59df1a1d0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:14:26.526947 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-89c38361-aeae-4a2c-a04d-da6b7e979f76 req-da311fab-e321-42cc-8fb7-6dfb2a461b29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e083a930-0680-4dbf-833e-d1bde6998d1f", "tag": "986e2677-0e75-42ab-a7e2-6b6a21c582d0"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:14:26.528153 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-50964708-f736-4648-9ca0-98320cbdcf03 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:14:26.528153 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-50964708-f736-4648-9ca0-98320cbdcf03 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:14:26.528821 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:14:26.528821 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:14:26.536142 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-89c38361-aeae-4a2c-a04d-da6b7e979f76 req-da311fab-e321-42cc-8fb7-6dfb2a461b29 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:26.536674 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-89c38361-aeae-4a2c-a04d-da6b7e979f76 req-da311fab-e321-42cc-8fb7-6dfb2a461b29 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:26.541296 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-50964708-f736-4648-9ca0-98320cbdcf03 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:26.541296 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-50964708-f736-4648-9ca0-98320cbdcf03 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:26.541296 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-50964708-f736-4648-9ca0-98320cbdcf03 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:26.541296 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-50964708-f736-4648-9ca0-98320cbdcf03 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:26.549448 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-89c38361-aeae-4a2c-a04d-da6b7e979f76 req-da311fab-e321-42cc-8fb7-6dfb2a461b29 service nova] Creating event network-changed:986e2677-0e75-42ab-a7e2-6b6a21c582d0 for instance e083a930-0680-4dbf-833e-d1bde6998d1f on hv-cinder-82002 Jan 19 16:14:26.556269 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-89c38361-aeae-4a2c-a04d-da6b7e979f76 req-da311fab-e321-42cc-8fb7-6dfb2a461b29 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032660 Jan 19 16:14:26.557440 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 734/1390] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:14:26.580491 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-50964708-f736-4648-9ca0-98320cbdcf03 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Going to try to terminate instance {{(pid=128875) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:14:26.892782 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-50964708-f736-4648-9ca0-98320cbdcf03 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 204 len: 0 microversion: 2.1 time: 0.369923 Jan 19 16:14:26.893376 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 657/1391] 10.222.0.58 () {58 vars in 1238 bytes} [Wed Jan 19 16:14:26 2022] DELETE /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:14:26.902223 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c55cca2e-dd44-477c-89a6-75933a4871d5 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:14:26.902917 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c55cca2e-dd44-477c-89a6-75933a4871d5 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:14:26.910688 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c55cca2e-dd44-477c-89a6-75933a4871d5 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:26.913362 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c55cca2e-dd44-477c-89a6-75933a4871d5 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:26.914399 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c55cca2e-dd44-477c-89a6-75933a4871d5 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:26.915031 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c55cca2e-dd44-477c-89a6-75933a4871d5 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:27.056931 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c55cca2e-dd44-477c-89a6-75933a4871d5 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:14:27.064864 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c55cca2e-dd44-477c-89a6-75933a4871d5 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1579 microversion: 2.1 time: 0.166645 Jan 19 16:14:27.065498 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 735/1392] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:14:26 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1579 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:14:28.083147 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-aea8e38d-d144-4b32-8b05-7be3b900742a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:14:28.083841 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-aea8e38d-d144-4b32-8b05-7be3b900742a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:14:28.090726 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-aea8e38d-d144-4b32-8b05-7be3b900742a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:28.091205 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-aea8e38d-d144-4b32-8b05-7be3b900742a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:28.091980 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-aea8e38d-d144-4b32-8b05-7be3b900742a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:28.092407 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-aea8e38d-d144-4b32-8b05-7be3b900742a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:28.267120 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-aea8e38d-d144-4b32-8b05-7be3b900742a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:14:28.275104 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-aea8e38d-d144-4b32-8b05-7be3b900742a tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1579 microversion: 2.1 time: 0.195951 Jan 19 16:14:28.275678 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 658/1393] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:14:28 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1579 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:14:29.294672 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5bbaf469-cca7-4314-9f35-cfafe4b9db5c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:14:29.295237 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5bbaf469-cca7-4314-9f35-cfafe4b9db5c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:14:29.301476 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5bbaf469-cca7-4314-9f35-cfafe4b9db5c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:29.301916 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5bbaf469-cca7-4314-9f35-cfafe4b9db5c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:29.302681 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5bbaf469-cca7-4314-9f35-cfafe4b9db5c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:29.303142 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5bbaf469-cca7-4314-9f35-cfafe4b9db5c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:29.435929 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5bbaf469-cca7-4314-9f35-cfafe4b9db5c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:14:29.443522 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5bbaf469-cca7-4314-9f35-cfafe4b9db5c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1579 microversion: 2.1 time: 0.152605 Jan 19 16:14:29.444095 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 736/1394] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:14:29 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1579 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:14:30.460325 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c3ded4d6-30c3-4f59-bb7f-06c769605200 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:14:30.460916 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c3ded4d6-30c3-4f59-bb7f-06c769605200 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:14:30.467051 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c3ded4d6-30c3-4f59-bb7f-06c769605200 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:30.467496 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c3ded4d6-30c3-4f59-bb7f-06c769605200 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:30.468276 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c3ded4d6-30c3-4f59-bb7f-06c769605200 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:30.468704 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c3ded4d6-30c3-4f59-bb7f-06c769605200 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:30.609397 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c3ded4d6-30c3-4f59-bb7f-06c769605200 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:14:30.617248 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c3ded4d6-30c3-4f59-bb7f-06c769605200 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1460 microversion: 2.1 time: 0.160529 Jan 19 16:14:30.617896 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 659/1395] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:14:30 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1460 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:14:31.635270 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-03b7a96b-3625-401c-984c-2f49f19cf8ba tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:14:31.635881 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-03b7a96b-3625-401c-984c-2f49f19cf8ba tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:14:31.642430 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-03b7a96b-3625-401c-984c-2f49f19cf8ba tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:31.642883 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-03b7a96b-3625-401c-984c-2f49f19cf8ba tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:31.643708 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-03b7a96b-3625-401c-984c-2f49f19cf8ba tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:31.644151 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-03b7a96b-3625-401c-984c-2f49f19cf8ba tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:31.779852 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-03b7a96b-3625-401c-984c-2f49f19cf8ba tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:14:31.788850 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-03b7a96b-3625-401c-984c-2f49f19cf8ba tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1460 microversion: 2.1 time: 0.157566 Jan 19 16:14:31.790320 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 737/1396] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:14:31 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1460 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:14:32.286548 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-b6872a2b-8d32-4d08-b367-d37d15a61ad3 req-d96bbe1b-e829-44ab-a8f8-75f18d864db2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e083a930-0680-4dbf-833e-d1bde6998d1f", "name": "network-vif-deleted", "tag": "986e2677-0e75-42ab-a7e2-6b6a21c582d0"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:14:32.287994 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:14:32.287994 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:14:32.296574 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-b6872a2b-8d32-4d08-b367-d37d15a61ad3 req-d96bbe1b-e829-44ab-a8f8-75f18d864db2 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:32.297348 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-b6872a2b-8d32-4d08-b367-d37d15a61ad3 req-d96bbe1b-e829-44ab-a8f8-75f18d864db2 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:32.314873 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-b6872a2b-8d32-4d08-b367-d37d15a61ad3 req-d96bbe1b-e829-44ab-a8f8-75f18d864db2 service nova] Creating event network-vif-deleted:986e2677-0e75-42ab-a7e2-6b6a21c582d0 for instance e083a930-0680-4dbf-833e-d1bde6998d1f on hv-cinder-82002 Jan 19 16:14:32.319892 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-b6872a2b-8d32-4d08-b367-d37d15a61ad3 req-d96bbe1b-e829-44ab-a8f8-75f18d864db2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037067 Jan 19 16:14:32.320497 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 660/1397] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:14:32.806741 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-3b6a52c1-eb56-438b-9316-709b8069f9fa tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:14:32.807372 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-3b6a52c1-eb56-438b-9316-709b8069f9fa tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:14:32.813811 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3b6a52c1-eb56-438b-9316-709b8069f9fa tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:32.814197 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3b6a52c1-eb56-438b-9316-709b8069f9fa tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:32.815044 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3b6a52c1-eb56-438b-9316-709b8069f9fa tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:32.815479 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3b6a52c1-eb56-438b-9316-709b8069f9fa tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:32.849006 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3b6a52c1-eb56-438b-9316-709b8069f9fa tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:32.849453 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-3b6a52c1-eb56-438b-9316-709b8069f9fa tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:32.849898 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.objects.instance [None req-3b6a52c1-eb56-438b-9316-709b8069f9fa tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lazy-loading 'fault' on Instance uuid e083a930-0680-4dbf-833e-d1bde6998d1f {{(pid=128876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:14:32.889505 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-3b6a52c1-eb56-438b-9316-709b8069f9fa tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054c8acefa4240469678db612ea73c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1086833404449a901e9a13cc93c8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:14:32.897028 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-3b6a52c1-eb56-438b-9316-709b8069f9fa tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 200 len: 1231 microversion: 2.1 time: 0.094197 Jan 19 16:14:32.897614 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 738/1398] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:14:32 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 1231 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:14:33.919732 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-58b111f9-57df-4d6b-96c3-326ee5dcfd4c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:14:33.920486 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-58b111f9-57df-4d6b-96c3-326ee5dcfd4c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: e083a930-0680-4dbf-833e-d1bde6998d1f] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:14:33.926581 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-58b111f9-57df-4d6b-96c3-326ee5dcfd4c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:33.927061 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-58b111f9-57df-4d6b-96c3-326ee5dcfd4c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:33.927852 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-58b111f9-57df-4d6b-96c3-326ee5dcfd4c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:33.928282 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-58b111f9-57df-4d6b-96c3-326ee5dcfd4c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:33.942735 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.wsgi [None req-58b111f9-57df-4d6b-96c3-326ee5dcfd4c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] HTTP exception thrown: Instance e083a930-0680-4dbf-833e-d1bde6998d1f could not be found. Jan 19 16:14:33.943356 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-58b111f9-57df-4d6b-96c3-326ee5dcfd4c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Returning 404 to user: Instance e083a930-0680-4dbf-833e-d1bde6998d1f could not be found. {{(pid=128875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:14:33.944197 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-58b111f9-57df-4d6b-96c3-326ee5dcfd4c tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f" status: 404 len: 111 microversion: 2.1 time: 0.029104 Jan 19 16:14:33.945016 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 661/1399] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:14:33 2022] GET /compute/v2.1/servers/e083a930-0680-4dbf-833e-d1bde6998d1f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:14:34.467284 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-6500ba1f-dc54-4d36-aaa9-e649a306a1f2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:14:34.467775 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-6500ba1f-dc54-4d36-aaa9-e649a306a1f2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:14:34.473951 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6500ba1f-dc54-4d36-aaa9-e649a306a1f2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:34.474387 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6500ba1f-dc54-4d36-aaa9-e649a306a1f2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:34.475210 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6500ba1f-dc54-4d36-aaa9-e649a306a1f2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:34.475643 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-6500ba1f-dc54-4d36-aaa9-e649a306a1f2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:34.488950 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.wsgi [None req-6500ba1f-dc54-4d36-aaa9-e649a306a1f2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] HTTP exception thrown: Instance 2a199868-949d-49fb-96e3-8c0befc8e20b could not be found. Jan 19 16:14:34.489522 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-6500ba1f-dc54-4d36-aaa9-e649a306a1f2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Returning 404 to user: Instance 2a199868-949d-49fb-96e3-8c0befc8e20b could not be found. {{(pid=128876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:14:34.490329 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-6500ba1f-dc54-4d36-aaa9-e649a306a1f2 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 404 len: 111 microversion: 2.1 time: 0.026796 Jan 19 16:14:34.490859 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 739/1400] 10.222.0.58 () {58 vars in 1238 bytes} [Wed Jan 19 16:14:34 2022] DELETE /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:14:34.498743 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-bf24ed3b-36b9-4ef4-834a-e5610809d874 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:14:34.499417 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-bf24ed3b-36b9-4ef4-834a-e5610809d874 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] [instance: 2a199868-949d-49fb-96e3-8c0befc8e20b] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:14:34.505514 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bf24ed3b-36b9-4ef4-834a-e5610809d874 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:34.505961 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bf24ed3b-36b9-4ef4-834a-e5610809d874 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:34.506767 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bf24ed3b-36b9-4ef4-834a-e5610809d874 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:14:34.507235 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bf24ed3b-36b9-4ef4-834a-e5610809d874 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:14:34.520367 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.wsgi [None req-bf24ed3b-36b9-4ef4-834a-e5610809d874 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] HTTP exception thrown: Instance 2a199868-949d-49fb-96e3-8c0befc8e20b could not be found. Jan 19 16:14:34.520949 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-bf24ed3b-36b9-4ef4-834a-e5610809d874 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Returning 404 to user: Instance 2a199868-949d-49fb-96e3-8c0befc8e20b could not be found. {{(pid=128875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:14:34.521780 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-bf24ed3b-36b9-4ef4-834a-e5610809d874 tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b" status: 404 len: 111 microversion: 2.1 time: 0.026788 Jan 19 16:14:34.522317 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 662/1401] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:14:34 2022] GET /compute/v2.1/servers/2a199868-949d-49fb-96e3-8c0befc8e20b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:14:40.325593 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-cb5462d1-4b0a-4808-b879-c0d9b95017da tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] Calling method '.version_select at 0x7feff5283b80>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:14:40.393327 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-cb5462d1-4b0a-4808-b879-c0d9b95017da tempest-TestVolumeBootPattern-501590205 tempest-TestVolumeBootPattern-501590205-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1630068289" status: 202 len: 0 microversion: 2.1 time: 0.073712 Jan 19 16:14:40.393912 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 740/1402] 10.222.0.58 () {58 vars in 1262 bytes} [Wed Jan 19 16:14:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1630068289 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:15:40.820320 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-2e908d60-5b0e-47ee-aa14-289e11b31b48 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Action: 'create', calling method: .version_select at 0x7feff54105e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2038940361"}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:15:40.834781 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-2e908d60-5b0e-47ee-aa14-289e11b31b48 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Getting quotas for project 175793bce6734cf6872bf073411a135d. Resources: {'key_pairs'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:15:40.838584 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-2e908d60-5b0e-47ee-aa14-289e11b31b48 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Getting quotas for user c3382a2439db46fb871bc50f6a5d8a7e and project 175793bce6734cf6872bf073411a135d. Resources: {'key_pairs'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:15:41.063871 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-2e908d60-5b0e-47ee-aa14-289e11b31b48 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Getting quotas for project 175793bce6734cf6872bf073411a135d. Resources: {'key_pairs'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:15:41.068119 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.quota [None req-2e908d60-5b0e-47ee-aa14-289e11b31b48 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Getting quotas for user c3382a2439db46fb871bc50f6a5d8a7e and project 175793bce6734cf6872bf073411a135d. Resources: {'key_pairs'} {{(pid=128875) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:15:41.081932 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-2e908d60-5b0e-47ee-aa14-289e11b31b48 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.266158 Jan 19 16:15:41.082529 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 663/1403] 10.222.0.58 () {60 vars in 1157 bytes} [Wed Jan 19 16:15:40 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:15:41.187997 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-94ef3840-ab74-4678-9811-301acd949317 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-272114410", "imageRef": "fe4eb76d-44de-4b21-be8f-6aff3a17a5a0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2038940361", "networks": [{"uuid": "752e9c5c-420f-4e3b-945e-31f66a8a7799"}]}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:15:41.238570 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.network.neutron [None req-94ef3840-ab74-4678-9811-301acd949317 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] validate_networks() for [('752e9c5c-420f-4e3b-945e-31f66a8a7799', None, None, None, None, None)] {{(pid=128876) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:15:41.905779 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-94ef3840-ab74-4678-9811-301acd949317 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Flavor limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:15:41.906199 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-94ef3840-ab74-4678-9811-301acd949317 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Image limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:15:41.906671 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-94ef3840-ab74-4678-9811-301acd949317 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Flavor pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:15:41.907116 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-94ef3840-ab74-4678-9811-301acd949317 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Image pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:15:41.907745 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-94ef3840-ab74-4678-9811-301acd949317 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:15:41.924929 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-94ef3840-ab74-4678-9811-301acd949317 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:41.925642 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-94ef3840-ab74-4678-9811-301acd949317 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:41.929474 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-94ef3840-ab74-4678-9811-301acd949317 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:41.929474 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-94ef3840-ab74-4678-9811-301acd949317 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:41.946110 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-94ef3840-ab74-4678-9811-301acd949317 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Getting quotas for project 175793bce6734cf6872bf073411a135d. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:15:41.952825 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-94ef3840-ab74-4678-9811-301acd949317 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Getting quotas for user c3382a2439db46fb871bc50f6a5d8a7e and project 175793bce6734cf6872bf073411a135d. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:15:41.964783 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-94ef3840-ab74-4678-9811-301acd949317 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Going to run 1 instances... {{(pid=128876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:15:41.967311 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-94ef3840-ab74-4678-9811-301acd949317 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe4eb76d-44de-4b21-be8f-6aff3a17a5a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:15:42.113761 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-94ef3840-ab74-4678-9811-301acd949317 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.930982 Jan 19 16:15:42.124014 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 741/1404] 10.222.0.58 () {60 vars in 1146 bytes} [Wed Jan 19 16:15:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:15:42.140840 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-7cde18c6-064c-4671-90fc-69e1a86d7b8a tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:15:42.148282 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-7cde18c6-064c-4671-90fc-69e1a86d7b8a tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:15:42.199226 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-7cde18c6-064c-4671-90fc-69e1a86d7b8a tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:15:42.208820 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-7cde18c6-064c-4671-90fc-69e1a86d7b8a tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1258 microversion: 2.1 time: 0.073914 Jan 19 16:15:42.210087 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 664/1405] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:15:42 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:15:43.228318 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f6c022ca-fbbb-4c87-879f-7ab4f1f6e7a6 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:15:43.229436 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f6c022ca-fbbb-4c87-879f-7ab4f1f6e7a6 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:15:43.334054 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f6c022ca-fbbb-4c87-879f-7ab4f1f6e7a6 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:15:43.343157 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f6c022ca-fbbb-4c87-879f-7ab4f1f6e7a6 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1258 microversion: 2.1 time: 0.119431 Jan 19 16:15:43.343764 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 742/1406] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:15:43 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1258 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:15:44.361423 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c43f4eb1-75de-4899-8a77-9593271d0f95 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:15:44.362770 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c43f4eb1-75de-4899-8a77-9593271d0f95 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:15:44.372049 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c43f4eb1-75de-4899-8a77-9593271d0f95 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:44.372965 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c43f4eb1-75de-4899-8a77-9593271d0f95 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:44.375408 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c43f4eb1-75de-4899-8a77-9593271d0f95 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:44.376036 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c43f4eb1-75de-4899-8a77-9593271d0f95 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:44.444279 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c43f4eb1-75de-4899-8a77-9593271d0f95 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:15:44.451737 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c43f4eb1-75de-4899-8a77-9593271d0f95 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1310 microversion: 2.1 time: 0.094936 Jan 19 16:15:44.452315 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 665/1407] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:15:44 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1310 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:15:45.468946 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8f8fdb85-aaa3-49ab-99d3-e102306667a3 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:15:45.469578 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-8f8fdb85-aaa3-49ab-99d3-e102306667a3 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:15:45.477530 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8f8fdb85-aaa3-49ab-99d3-e102306667a3 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:45.477985 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8f8fdb85-aaa3-49ab-99d3-e102306667a3 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:45.485777 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8f8fdb85-aaa3-49ab-99d3-e102306667a3 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:45.486306 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8f8fdb85-aaa3-49ab-99d3-e102306667a3 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:45.675836 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8f8fdb85-aaa3-49ab-99d3-e102306667a3 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:15:45.686002 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-8f8fdb85-aaa3-49ab-99d3-e102306667a3 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1316 microversion: 2.1 time: 0.221116 Jan 19 16:15:45.686622 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 743/1408] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:15:45 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1316 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:15:46.709132 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-2711a7cc-e0a0-4d28-82b0-73c901ecafd1 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:15:46.710159 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-2711a7cc-e0a0-4d28-82b0-73c901ecafd1 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:15:46.724403 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2711a7cc-e0a0-4d28-82b0-73c901ecafd1 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:46.727102 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2711a7cc-e0a0-4d28-82b0-73c901ecafd1 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:46.729878 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2711a7cc-e0a0-4d28-82b0-73c901ecafd1 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:46.735606 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2711a7cc-e0a0-4d28-82b0-73c901ecafd1 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:47.210925 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-2711a7cc-e0a0-4d28-82b0-73c901ecafd1 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:15:47.234896 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-2711a7cc-e0a0-4d28-82b0-73c901ecafd1 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1358 microversion: 2.1 time: 0.532979 Jan 19 16:15:47.240651 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 666/1409] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:15:46 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1358 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:15:47.465762 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-1dde33f1-53c2-424b-9547-14558bbb7858 req-6e6703e3-f566-4106-b1ba-d3769da9ed08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50e42108-979c-426b-8467-f311f9752a06", "tag": "e47b7859-7c68-4e32-91ab-306cff6c827e"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:15:47.467635 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:15:47.467635 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:15:47.495672 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-1dde33f1-53c2-424b-9547-14558bbb7858 req-6e6703e3-f566-4106-b1ba-d3769da9ed08 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:47.497750 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-1dde33f1-53c2-424b-9547-14558bbb7858 req-6e6703e3-f566-4106-b1ba-d3769da9ed08 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:47.612302 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-1dde33f1-53c2-424b-9547-14558bbb7858 req-6e6703e3-f566-4106-b1ba-d3769da9ed08 service nova] Creating event network-changed:e47b7859-7c68-4e32-91ab-306cff6c827e for instance 50e42108-979c-426b-8467-f311f9752a06 on hv-cinder-82002 Jan 19 16:15:47.629913 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-1dde33f1-53c2-424b-9547-14558bbb7858 req-6e6703e3-f566-4106-b1ba-d3769da9ed08 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165736 Jan 19 16:15:47.632056 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 667/1410] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:15:47.898813 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d242618e-aa67-4841-8741-b8712cd8cdb1 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Action: 'create', calling method: .version_select at 0x7feff51f33a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1051393053"}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:15:47.928092 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-d242618e-aa67-4841-8741-b8712cd8cdb1 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Getting quotas for project cc18ab6f6557436981a09d61b4dbdf96. Resources: {'key_pairs'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:15:47.932871 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-d242618e-aa67-4841-8741-b8712cd8cdb1 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Getting quotas for user 23073a05bdd7436eb1cca41b41bf7ea1 and project cc18ab6f6557436981a09d61b4dbdf96. Resources: {'key_pairs'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:15:48.257636 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-62857b07-2683-461e-9d51-7299b1261a1e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:15:48.258373 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-62857b07-2683-461e-9d51-7299b1261a1e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:15:48.266021 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-62857b07-2683-461e-9d51-7299b1261a1e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:48.266758 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-62857b07-2683-461e-9d51-7299b1261a1e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:48.267787 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-62857b07-2683-461e-9d51-7299b1261a1e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:48.268383 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-62857b07-2683-461e-9d51-7299b1261a1e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:48.478904 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-62857b07-2683-461e-9d51-7299b1261a1e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:15:48.487874 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-62857b07-2683-461e-9d51-7299b1261a1e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1358 microversion: 2.1 time: 0.234324 Jan 19 16:15:48.488464 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 668/1411] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:15:48 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:15:48.575900 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-d242618e-aa67-4841-8741-b8712cd8cdb1 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Getting quotas for project cc18ab6f6557436981a09d61b4dbdf96. Resources: {'key_pairs'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:15:48.580338 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-d242618e-aa67-4841-8741-b8712cd8cdb1 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Getting quotas for user 23073a05bdd7436eb1cca41b41bf7ea1 and project cc18ab6f6557436981a09d61b4dbdf96. Resources: {'key_pairs'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:15:48.594478 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-d242618e-aa67-4841-8741-b8712cd8cdb1 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 1.157974 Jan 19 16:15:48.595407 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 744/1412] 10.222.0.58 () {60 vars in 1157 bytes} [Wed Jan 19 16:15:47 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:15:49.515800 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-74178e43-fc59-43c8-8663-967e46126465 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:15:49.517143 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-74178e43-fc59-43c8-8663-967e46126465 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:15:49.531958 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-74178e43-fc59-43c8-8663-967e46126465 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:49.532938 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-74178e43-fc59-43c8-8663-967e46126465 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:49.533856 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-74178e43-fc59-43c8-8663-967e46126465 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:49.534366 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-74178e43-fc59-43c8-8663-967e46126465 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:49.817531 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-74178e43-fc59-43c8-8663-967e46126465 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:15:49.827746 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-74178e43-fc59-43c8-8663-967e46126465 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1358 microversion: 2.1 time: 0.316302 Jan 19 16:15:49.833834 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 669/1413] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:15:49 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1358 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:15:50.846704 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-971c8371-3c1c-4e58-9961-604b46017e17 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:15:50.847516 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-971c8371-3c1c-4e58-9961-604b46017e17 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:15:50.868725 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-971c8371-3c1c-4e58-9961-604b46017e17 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:50.872706 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-971c8371-3c1c-4e58-9961-604b46017e17 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:50.879130 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-971c8371-3c1c-4e58-9961-604b46017e17 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:50.879130 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-971c8371-3c1c-4e58-9961-604b46017e17 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:51.074420 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-971c8371-3c1c-4e58-9961-604b46017e17 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:15:51.081850 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-971c8371-3c1c-4e58-9961-604b46017e17 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1358 microversion: 2.1 time: 0.240692 Jan 19 16:15:51.082449 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 745/1414] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:15:50 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:15:52.100985 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-8bebe3ea-f8f1-4d13-b95b-f241fefc873e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:15:52.102299 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-8bebe3ea-f8f1-4d13-b95b-f241fefc873e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:15:52.114618 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8bebe3ea-f8f1-4d13-b95b-f241fefc873e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:52.115349 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8bebe3ea-f8f1-4d13-b95b-f241fefc873e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:52.116406 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8bebe3ea-f8f1-4d13-b95b-f241fefc873e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:52.116898 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-8bebe3ea-f8f1-4d13-b95b-f241fefc873e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:52.336333 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-8bebe3ea-f8f1-4d13-b95b-f241fefc873e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:15:52.353599 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-8bebe3ea-f8f1-4d13-b95b-f241fefc873e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1358 microversion: 2.1 time: 0.257675 Jan 19 16:15:52.356535 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 670/1415] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:15:52 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1358 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:15:53.373826 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d0d02ea2-6d16-462f-88bb-382498f0db24 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:15:53.374569 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-d0d02ea2-6d16-462f-88bb-382498f0db24 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:15:53.387705 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d0d02ea2-6d16-462f-88bb-382498f0db24 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:53.391152 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d0d02ea2-6d16-462f-88bb-382498f0db24 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:53.391152 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d0d02ea2-6d16-462f-88bb-382498f0db24 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:53.391152 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d0d02ea2-6d16-462f-88bb-382498f0db24 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:53.624929 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-d0d02ea2-6d16-462f-88bb-382498f0db24 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:15:53.636971 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-d0d02ea2-6d16-462f-88bb-382498f0db24 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1358 microversion: 2.1 time: 0.268141 Jan 19 16:15:53.639045 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 746/1416] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:15:53 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1358 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:15:54.654346 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-58f0a01a-b8a4-43bc-85f8-f488557e213e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:15:54.654942 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-58f0a01a-b8a4-43bc-85f8-f488557e213e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:15:54.661197 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-58f0a01a-b8a4-43bc-85f8-f488557e213e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:54.661636 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-58f0a01a-b8a4-43bc-85f8-f488557e213e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:54.662407 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-58f0a01a-b8a4-43bc-85f8-f488557e213e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:54.662830 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-58f0a01a-b8a4-43bc-85f8-f488557e213e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:54.801588 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-58f0a01a-b8a4-43bc-85f8-f488557e213e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:15:54.809636 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-58f0a01a-b8a4-43bc-85f8-f488557e213e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1358 microversion: 2.1 time: 0.159811 Jan 19 16:15:54.810197 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 671/1417] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:15:54 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:15:55.827387 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-fd1c93a1-2574-402f-82f6-5bfdc796d10e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:15:55.828418 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-fd1c93a1-2574-402f-82f6-5bfdc796d10e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:15:55.835341 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fd1c93a1-2574-402f-82f6-5bfdc796d10e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:55.835777 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fd1c93a1-2574-402f-82f6-5bfdc796d10e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:55.836573 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fd1c93a1-2574-402f-82f6-5bfdc796d10e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:55.837002 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-fd1c93a1-2574-402f-82f6-5bfdc796d10e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:55.976304 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-fd1c93a1-2574-402f-82f6-5bfdc796d10e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:15:55.984332 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-fd1c93a1-2574-402f-82f6-5bfdc796d10e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1358 microversion: 2.1 time: 0.161323 Jan 19 16:15:55.984983 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 747/1418] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:15:55 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:15:57.003167 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-bd3fc73c-0cc8-4b55-96c9-0c39cb042364 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:15:57.003756 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-bd3fc73c-0cc8-4b55-96c9-0c39cb042364 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:15:57.009897 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bd3fc73c-0cc8-4b55-96c9-0c39cb042364 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:57.010339 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bd3fc73c-0cc8-4b55-96c9-0c39cb042364 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:57.011166 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bd3fc73c-0cc8-4b55-96c9-0c39cb042364 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:57.011625 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bd3fc73c-0cc8-4b55-96c9-0c39cb042364 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:57.178092 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-bd3fc73c-0cc8-4b55-96c9-0c39cb042364 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:15:57.186998 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-bd3fc73c-0cc8-4b55-96c9-0c39cb042364 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1358 microversion: 2.1 time: 0.187430 Jan 19 16:15:57.187712 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 672/1419] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:15:56 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:15:58.204834 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-4e9352a2-8b8d-4901-8980-89091d4774e3 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:15:58.205396 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-4e9352a2-8b8d-4901-8980-89091d4774e3 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:15:58.211392 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4e9352a2-8b8d-4901-8980-89091d4774e3 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:58.211831 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4e9352a2-8b8d-4901-8980-89091d4774e3 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:58.212611 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4e9352a2-8b8d-4901-8980-89091d4774e3 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:58.213037 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4e9352a2-8b8d-4901-8980-89091d4774e3 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:58.358280 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-4e9352a2-8b8d-4901-8980-89091d4774e3 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:15:58.365645 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-4e9352a2-8b8d-4901-8980-89091d4774e3 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1358 microversion: 2.1 time: 0.164751 Jan 19 16:15:58.366214 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 748/1420] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:15:58 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:15:59.381441 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-3e943e91-c80f-4ccf-9be4-2922b94b8a39 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:15:59.381994 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-3e943e91-c80f-4ccf-9be4-2922b94b8a39 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:15:59.388318 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3e943e91-c80f-4ccf-9be4-2922b94b8a39 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:59.388756 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3e943e91-c80f-4ccf-9be4-2922b94b8a39 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:59.389526 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3e943e91-c80f-4ccf-9be4-2922b94b8a39 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:15:59.389950 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-3e943e91-c80f-4ccf-9be4-2922b94b8a39 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:15:59.522347 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-3e943e91-c80f-4ccf-9be4-2922b94b8a39 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:15:59.531002 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-3e943e91-c80f-4ccf-9be4-2922b94b8a39 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1358 microversion: 2.1 time: 0.153134 Jan 19 16:15:59.531664 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 673/1421] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:15:59 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:00.547952 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b56560b8-3f54-418d-9952-98ccbaaf6d70 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:00.548561 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b56560b8-3f54-418d-9952-98ccbaaf6d70 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:00.554756 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b56560b8-3f54-418d-9952-98ccbaaf6d70 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:00.555236 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b56560b8-3f54-418d-9952-98ccbaaf6d70 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:00.556016 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b56560b8-3f54-418d-9952-98ccbaaf6d70 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:00.556729 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b56560b8-3f54-418d-9952-98ccbaaf6d70 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:00.693198 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-b56560b8-3f54-418d-9952-98ccbaaf6d70 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:00.701153 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b56560b8-3f54-418d-9952-98ccbaaf6d70 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1358 microversion: 2.1 time: 0.157446 Jan 19 16:16:00.701714 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 749/1422] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:00 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:01.716979 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-7723fc40-0eea-4f6e-8998-fedd74cf1efd tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:01.717584 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-7723fc40-0eea-4f6e-8998-fedd74cf1efd tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:01.723896 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7723fc40-0eea-4f6e-8998-fedd74cf1efd tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:01.724340 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7723fc40-0eea-4f6e-8998-fedd74cf1efd tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:01.725113 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7723fc40-0eea-4f6e-8998-fedd74cf1efd tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:01.725537 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-7723fc40-0eea-4f6e-8998-fedd74cf1efd tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:01.861635 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-7723fc40-0eea-4f6e-8998-fedd74cf1efd tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:01.868857 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-7723fc40-0eea-4f6e-8998-fedd74cf1efd tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1358 microversion: 2.1 time: 0.155623 Jan 19 16:16:01.869422 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 674/1423] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:01 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:02.887278 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f9724460-8056-4882-b939-6e139b7f159e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:02.887884 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f9724460-8056-4882-b939-6e139b7f159e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:02.894231 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f9724460-8056-4882-b939-6e139b7f159e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:02.894833 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f9724460-8056-4882-b939-6e139b7f159e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:02.895661 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f9724460-8056-4882-b939-6e139b7f159e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:02.896142 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f9724460-8056-4882-b939-6e139b7f159e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:03.032170 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f9724460-8056-4882-b939-6e139b7f159e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:03.039510 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f9724460-8056-4882-b939-6e139b7f159e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1358 microversion: 2.1 time: 0.155985 Jan 19 16:16:03.040088 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 750/1424] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:02 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:04.057025 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-303391b4-263b-4b89-a2d8-a28da57e3a7c tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:04.057626 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-303391b4-263b-4b89-a2d8-a28da57e3a7c tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:04.064745 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-303391b4-263b-4b89-a2d8-a28da57e3a7c tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:04.065184 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-303391b4-263b-4b89-a2d8-a28da57e3a7c tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:04.065955 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-303391b4-263b-4b89-a2d8-a28da57e3a7c tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:04.066380 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-303391b4-263b-4b89-a2d8-a28da57e3a7c tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:04.196440 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-303391b4-263b-4b89-a2d8-a28da57e3a7c tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:04.203804 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-303391b4-263b-4b89-a2d8-a28da57e3a7c tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1358 microversion: 2.1 time: 0.150730 Jan 19 16:16:04.204376 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 675/1425] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:04 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:04.504299 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-5c43400d-2eab-4d2a-843b-465ed3b991d6 req-2aaf64ef-7668-4070-9b70-c5aa4a38b5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50e42108-979c-426b-8467-f311f9752a06", "name": "network-vif-plugged", "status": "completed", "tag": "e47b7859-7c68-4e32-91ab-306cff6c827e"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:16:04.506150 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:16:04.506150 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:16:04.513125 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-5c43400d-2eab-4d2a-843b-465ed3b991d6 req-2aaf64ef-7668-4070-9b70-c5aa4a38b5ef service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:04.513639 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-5c43400d-2eab-4d2a-843b-465ed3b991d6 req-2aaf64ef-7668-4070-9b70-c5aa4a38b5ef service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:04.524905 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-5c43400d-2eab-4d2a-843b-465ed3b991d6 req-2aaf64ef-7668-4070-9b70-c5aa4a38b5ef service nova] Creating event network-vif-plugged:e47b7859-7c68-4e32-91ab-306cff6c827e for instance 50e42108-979c-426b-8467-f311f9752a06 on hv-cinder-82002 Jan 19 16:16:04.530669 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-5c43400d-2eab-4d2a-843b-465ed3b991d6 req-2aaf64ef-7668-4070-9b70-c5aa4a38b5ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084944 Jan 19 16:16:04.531310 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 751/1426] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:16:05.220597 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ecf62d3d-9f81-4fd7-a663-ae5781ea01d6 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:05.221145 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-ecf62d3d-9f81-4fd7-a663-ae5781ea01d6 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:05.227476 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ecf62d3d-9f81-4fd7-a663-ae5781ea01d6 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:05.227918 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ecf62d3d-9f81-4fd7-a663-ae5781ea01d6 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:05.228693 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ecf62d3d-9f81-4fd7-a663-ae5781ea01d6 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:05.229126 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ecf62d3d-9f81-4fd7-a663-ae5781ea01d6 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:05.356165 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ecf62d3d-9f81-4fd7-a663-ae5781ea01d6 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:05.363547 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-ecf62d3d-9f81-4fd7-a663-ae5781ea01d6 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1358 microversion: 2.1 time: 0.146748 Jan 19 16:16:05.364116 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 676/1427] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:05 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:06.380673 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-d743bf89-fa22-41f4-a1a2-817bbd2aefdb tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:06.381420 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-d743bf89-fa22-41f4-a1a2-817bbd2aefdb tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:06.387804 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d743bf89-fa22-41f4-a1a2-817bbd2aefdb tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:06.388239 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d743bf89-fa22-41f4-a1a2-817bbd2aefdb tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:06.389028 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d743bf89-fa22-41f4-a1a2-817bbd2aefdb tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:06.389450 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-d743bf89-fa22-41f4-a1a2-817bbd2aefdb tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:06.521838 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-d743bf89-fa22-41f4-a1a2-817bbd2aefdb tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:06.529843 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-d743bf89-fa22-41f4-a1a2-817bbd2aefdb tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1358 microversion: 2.1 time: 0.153614 Jan 19 16:16:06.530466 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 752/1428] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:06 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:07.545511 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-2b387fdd-e271-4aaf-b2b2-39a68cf5f9fc tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:07.546106 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-2b387fdd-e271-4aaf-b2b2-39a68cf5f9fc tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:07.552403 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2b387fdd-e271-4aaf-b2b2-39a68cf5f9fc tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:07.552839 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2b387fdd-e271-4aaf-b2b2-39a68cf5f9fc tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:07.553610 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2b387fdd-e271-4aaf-b2b2-39a68cf5f9fc tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:07.554036 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-2b387fdd-e271-4aaf-b2b2-39a68cf5f9fc tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:07.683686 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-2b387fdd-e271-4aaf-b2b2-39a68cf5f9fc tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:07.691457 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-2b387fdd-e271-4aaf-b2b2-39a68cf5f9fc tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1547 microversion: 2.1 time: 0.149763 Jan 19 16:16:07.692020 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 677/1429] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:07 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:07.707850 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a6905e56-72a2-422a-b15b-9b9d5ae896bf tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:07.708472 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a6905e56-72a2-422a-b15b-9b9d5ae896bf tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:07.714623 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a6905e56-72a2-422a-b15b-9b9d5ae896bf tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:07.715100 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a6905e56-72a2-422a-b15b-9b9d5ae896bf tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:07.715885 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a6905e56-72a2-422a-b15b-9b9d5ae896bf tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:07.716306 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a6905e56-72a2-422a-b15b-9b9d5ae896bf tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:07.844845 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a6905e56-72a2-422a-b15b-9b9d5ae896bf tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:07.852230 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a6905e56-72a2-422a-b15b-9b9d5ae896bf tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1547 microversion: 2.1 time: 0.148020 Jan 19 16:16:07.858641 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 753/1430] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:07 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:07.872130 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-c16d98e0-ea67-4cf9-a5a7-1d681d2bab6e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:07.875825 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:16:07.875825 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:16:07.876850 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-c16d98e0-ea67-4cf9-a5a7-1d681d2bab6e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:07.877587 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-c16d98e0-ea67-4cf9-a5a7-1d681d2bab6e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Searching by: {'deleted': False, 'project_id': '175793bce6734cf6872bf073411a135d'} {{(pid=128875) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 19 16:16:07.884008 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c16d98e0-ea67-4cf9-a5a7-1d681d2bab6e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:07.894201 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c16d98e0-ea67-4cf9-a5a7-1d681d2bab6e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:07.894201 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c16d98e0-ea67-4cf9-a5a7-1d681d2bab6e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:07.894201 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-c16d98e0-ea67-4cf9-a5a7-1d681d2bab6e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:07.974425 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.multi_cell_list [None req-c16d98e0-ea67-4cf9-a5a7-1d681d2bab6e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 19 16:16:08.069355 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-c16d98e0-ea67-4cf9-a5a7-1d681d2bab6e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.200938 Jan 19 16:16:08.069948 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 678/1431] 10.222.0.58 () {58 vars in 1124 bytes} [Wed Jan 19 16:16:07 2022] GET /compute/v2.1/servers => generated 342 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:16:08.080600 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-b76c353f-f859-49a8-8a25-de27a045905e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:08.081314 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-b76c353f-f859-49a8-8a25-de27a045905e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:08.088100 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b76c353f-f859-49a8-8a25-de27a045905e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:08.088644 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b76c353f-f859-49a8-8a25-de27a045905e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:08.089537 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b76c353f-f859-49a8-8a25-de27a045905e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:08.090042 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-b76c353f-f859-49a8-8a25-de27a045905e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:08.223801 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-b76c353f-f859-49a8-8a25-de27a045905e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:08.231155 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-b76c353f-f859-49a8-8a25-de27a045905e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1547 microversion: 2.1 time: 0.154400 Jan 19 16:16:08.232352 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 754/1432] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:08 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:11.187293 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-5d76bf51-d6dc-4c28-894d-80675955153f tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d57d91da-0456-40df-8ba5-538303897d6f"}} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:16:11.188337 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-5d76bf51-d6dc-4c28-894d-80675955153f tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:11.194533 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5d76bf51-d6dc-4c28-894d-80675955153f tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:11.195000 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5d76bf51-d6dc-4c28-894d-80675955153f tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:11.195766 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5d76bf51-d6dc-4c28-894d-80675955153f tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:11.196189 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-5d76bf51-d6dc-4c28-894d-80675955153f tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:11.996920 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-5d76bf51-d6dc-4c28-894d-80675955153f tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "POST /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.813881 Jan 19 16:16:11.998044 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 679/1433] 10.222.0.58 () {60 vars in 1322 bytes} [Wed Jan 19 16:16:11 2022] POST /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06/os-volume_attachments => generated 194 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:16:14.231943 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5dea5936-844a-4ebd-9c78-3e135ad0e393 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1527420367", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1051393053", "security_groups": [{"name": "tempest-secgroup-smoke-708167703"}], "networks": [{"uuid": "58820449-8688-4f9b-af16-9a6613a7fef9"}], "block_device_mapping_v2": [{"uuid": "913e077a-cabc-4cad-8a03-dcc536154dde", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:16:14.347926 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.network.neutron [None req-5dea5936-844a-4ebd-9c78-3e135ad0e393 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] validate_networks() for [('58820449-8688-4f9b-af16-9a6613a7fef9', None, None, None, None, None)] {{(pid=128876) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:16:14.722871 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-5dea5936-844a-4ebd-9c78-3e135ad0e393 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Flavor limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:16:14.723322 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-5dea5936-844a-4ebd-9c78-3e135ad0e393 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Image limits 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:16:14.723792 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-5dea5936-844a-4ebd-9c78-3e135ad0e393 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Flavor pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:16:14.724197 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-5dea5936-844a-4ebd-9c78-3e135ad0e393 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Image pref 0:0:0 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:16:14.724604 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.virt.hardware [None req-5dea5936-844a-4ebd-9c78-3e135ad0e393 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:16:14.733256 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5dea5936-844a-4ebd-9c78-3e135ad0e393 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:14.733695 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5dea5936-844a-4ebd-9c78-3e135ad0e393 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:14.734508 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5dea5936-844a-4ebd-9c78-3e135ad0e393 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:14.734939 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5dea5936-844a-4ebd-9c78-3e135ad0e393 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:14.751414 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-5dea5936-844a-4ebd-9c78-3e135ad0e393 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Getting quotas for project cc18ab6f6557436981a09d61b4dbdf96. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:16:14.755314 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.quota [None req-5dea5936-844a-4ebd-9c78-3e135ad0e393 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Getting quotas for user 23073a05bdd7436eb1cca41b41bf7ea1 and project cc18ab6f6557436981a09d61b4dbdf96. Resources: {'ram', 'cores', 'instances'} {{(pid=128876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:16:14.809176 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5dea5936-844a-4ebd-9c78-3e135ad0e393 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Going to run 1 instances... {{(pid=128876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:16:14.811882 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5dea5936-844a-4ebd-9c78-3e135ad0e393 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] [instance: ca130df7-d259-4d74-bdd5-359e571fdbfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='913e077a-cabc-4cad-8a03-dcc536154dde',volume_size=None,volume_type=None)] {{(pid=128876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:16:15.144537 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5dea5936-844a-4ebd-9c78-3e135ad0e393 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.916171 Jan 19 16:16:15.145174 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 755/1434] 10.222.0.58 () {60 vars in 1146 bytes} [Wed Jan 19 16:16:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:16:15.155928 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-f8b4cb50-a68a-4be2-82c6-1e34e2ec474e tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:15.156796 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-f8b4cb50-a68a-4be2-82c6-1e34e2ec474e tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] [instance: ca130df7-d259-4d74-bdd5-359e571fdbfc] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:15.215421 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-f8b4cb50-a68a-4be2-82c6-1e34e2ec474e tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23073a05bdd7436eb1cca41b41bf7ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18ab6f6557436981a09d61b4dbdf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:15.222201 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-f8b4cb50-a68a-4be2-82c6-1e34e2ec474e tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] 10.222.0.58 "GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc" status: 200 len: 1089 microversion: 2.1 time: 0.070680 Jan 19 16:16:15.222784 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 680/1435] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:15 2022] GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:16.240407 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-7a5fd124-d545-4361-b117-ce13afbc097b tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:16.241851 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-7a5fd124-d545-4361-b117-ce13afbc097b tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] [instance: ca130df7-d259-4d74-bdd5-359e571fdbfc] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:16.248315 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7a5fd124-d545-4361-b117-ce13afbc097b tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:16.248774 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7a5fd124-d545-4361-b117-ce13afbc097b tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:16.249589 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7a5fd124-d545-4361-b117-ce13afbc097b tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:16.250212 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-7a5fd124-d545-4361-b117-ce13afbc097b tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:16.314289 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-7a5fd124-d545-4361-b117-ce13afbc097b tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23073a05bdd7436eb1cca41b41bf7ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18ab6f6557436981a09d61b4dbdf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:16.327477 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-7a5fd124-d545-4361-b117-ce13afbc097b tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] 10.222.0.58 "GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc" status: 200 len: 1139 microversion: 2.1 time: 0.090866 Jan 19 16:16:16.328519 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 756/1436] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:16 2022] GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc => generated 1139 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:17.349562 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-96e27301-a8fb-4438-b05c-2d90d25a6a36 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:17.350171 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-96e27301-a8fb-4438-b05c-2d90d25a6a36 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] [instance: ca130df7-d259-4d74-bdd5-359e571fdbfc] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:17.358172 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-96e27301-a8fb-4438-b05c-2d90d25a6a36 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:17.358590 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-96e27301-a8fb-4438-b05c-2d90d25a6a36 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:17.359417 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-96e27301-a8fb-4438-b05c-2d90d25a6a36 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:17.359852 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-96e27301-a8fb-4438-b05c-2d90d25a6a36 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:17.455073 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-96e27301-a8fb-4438-b05c-2d90d25a6a36 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23073a05bdd7436eb1cca41b41bf7ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18ab6f6557436981a09d61b4dbdf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:17.463244 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-96e27301-a8fb-4438-b05c-2d90d25a6a36 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] 10.222.0.58 "GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc" status: 200 len: 1195 microversion: 2.1 time: 0.118092 Jan 19 16:16:17.463814 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 681/1437] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:17 2022] GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc => generated 1195 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:18.479685 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5218376a-fb05-412b-b81c-914fa67ecd09 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:18.480273 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5218376a-fb05-412b-b81c-914fa67ecd09 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] [instance: ca130df7-d259-4d74-bdd5-359e571fdbfc] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:18.486620 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5218376a-fb05-412b-b81c-914fa67ecd09 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:18.487126 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5218376a-fb05-412b-b81c-914fa67ecd09 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:18.487910 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5218376a-fb05-412b-b81c-914fa67ecd09 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:18.488342 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5218376a-fb05-412b-b81c-914fa67ecd09 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:18.624284 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5218376a-fb05-412b-b81c-914fa67ecd09 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23073a05bdd7436eb1cca41b41bf7ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18ab6f6557436981a09d61b4dbdf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:18.633003 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5218376a-fb05-412b-b81c-914fa67ecd09 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] 10.222.0.58 "GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc" status: 200 len: 1272 microversion: 2.1 time: 0.157174 Jan 19 16:16:18.636020 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 757/1438] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:18 2022] GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:18.954416 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-04a6d168-5e91-48c6-94ef-084fd7b2c228 req-a31f4d9b-6126-4476-9a91-2711e2209f22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca130df7-d259-4d74-bdd5-359e571fdbfc", "tag": "429298e6-f280-4ecf-8e87-0f62a06d829c"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:16:18.960008 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:16:18.960008 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:16:18.969248 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-04a6d168-5e91-48c6-94ef-084fd7b2c228 req-a31f4d9b-6126-4476-9a91-2711e2209f22 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:18.969816 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-04a6d168-5e91-48c6-94ef-084fd7b2c228 req-a31f4d9b-6126-4476-9a91-2711e2209f22 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:18.988455 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-04a6d168-5e91-48c6-94ef-084fd7b2c228 req-a31f4d9b-6126-4476-9a91-2711e2209f22 service nova] Creating event network-changed:429298e6-f280-4ecf-8e87-0f62a06d829c for instance ca130df7-d259-4d74-bdd5-359e571fdbfc on hv-cinder-82002 Jan 19 16:16:18.994114 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-04a6d168-5e91-48c6-94ef-084fd7b2c228 req-a31f4d9b-6126-4476-9a91-2711e2209f22 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045348 Jan 19 16:16:18.994729 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 682/1439] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:16:19.524022 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5d5d13d7-1ffc-4617-a50f-57a2109f8e57 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:19.524557 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5d5d13d7-1ffc-4617-a50f-57a2109f8e57 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:19.531763 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5d5d13d7-1ffc-4617-a50f-57a2109f8e57 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:19.532212 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5d5d13d7-1ffc-4617-a50f-57a2109f8e57 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:19.533006 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5d5d13d7-1ffc-4617-a50f-57a2109f8e57 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:19.533441 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5d5d13d7-1ffc-4617-a50f-57a2109f8e57 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:19.653654 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e29ae51b-fb57-4b43-8592-509944089a7f tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:19.654549 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-e29ae51b-fb57-4b43-8592-509944089a7f tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] [instance: ca130df7-d259-4d74-bdd5-359e571fdbfc] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:19.661401 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e29ae51b-fb57-4b43-8592-509944089a7f tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:19.662211 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e29ae51b-fb57-4b43-8592-509944089a7f tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:19.663128 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e29ae51b-fb57-4b43-8592-509944089a7f tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:19.663652 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e29ae51b-fb57-4b43-8592-509944089a7f tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:19.671585 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5d5d13d7-1ffc-4617-a50f-57a2109f8e57 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:19.679606 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5d5d13d7-1ffc-4617-a50f-57a2109f8e57 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1593 microversion: 2.1 time: 0.159339 Jan 19 16:16:19.680801 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 758/1440] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:19 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1593 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:19.828229 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e29ae51b-fb57-4b43-8592-509944089a7f tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23073a05bdd7436eb1cca41b41bf7ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18ab6f6557436981a09d61b4dbdf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:19.835732 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e29ae51b-fb57-4b43-8592-509944089a7f tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] 10.222.0.58 "GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc" status: 200 len: 1272 microversion: 2.1 time: 0.186058 Jan 19 16:16:19.836302 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 683/1441] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:19 2022] GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc => generated 1272 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:16:20.851494 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-46b9ed6b-262f-489d-8634-1a3a127ebae9 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:20.852113 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-46b9ed6b-262f-489d-8634-1a3a127ebae9 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] [instance: ca130df7-d259-4d74-bdd5-359e571fdbfc] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:20.858578 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-46b9ed6b-262f-489d-8634-1a3a127ebae9 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:20.859779 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-46b9ed6b-262f-489d-8634-1a3a127ebae9 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:20.860499 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-46b9ed6b-262f-489d-8634-1a3a127ebae9 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:20.861013 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-46b9ed6b-262f-489d-8634-1a3a127ebae9 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:21.005602 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-46b9ed6b-262f-489d-8634-1a3a127ebae9 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23073a05bdd7436eb1cca41b41bf7ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18ab6f6557436981a09d61b4dbdf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:21.013643 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-46b9ed6b-262f-489d-8634-1a3a127ebae9 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] 10.222.0.58 "GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc" status: 200 len: 1260 microversion: 2.1 time: 0.165728 Jan 19 16:16:21.025053 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 759/1442] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:20 2022] GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:22.031876 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-4b0fabce-2802-4e40-bd34-8b377d202801 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:22.032476 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-4b0fabce-2802-4e40-bd34-8b377d202801 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] [instance: ca130df7-d259-4d74-bdd5-359e571fdbfc] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:22.038798 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4b0fabce-2802-4e40-bd34-8b377d202801 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:22.039286 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4b0fabce-2802-4e40-bd34-8b377d202801 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:22.040331 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4b0fabce-2802-4e40-bd34-8b377d202801 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:22.040716 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-4b0fabce-2802-4e40-bd34-8b377d202801 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:22.136311 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-51a0d2b5-bc33-4f09-83d6-050d8d502dbf req-68dfef19-140d-4671-9853-4bd0b0b8ccfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50e42108-979c-426b-8467-f311f9752a06", "tag": "e47b7859-7c68-4e32-91ab-306cff6c827e"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:16:22.137910 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:16:22.137910 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:16:22.146138 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-51a0d2b5-bc33-4f09-83d6-050d8d502dbf req-68dfef19-140d-4671-9853-4bd0b0b8ccfa service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:22.146689 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-51a0d2b5-bc33-4f09-83d6-050d8d502dbf req-68dfef19-140d-4671-9853-4bd0b0b8ccfa service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:22.158390 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-51a0d2b5-bc33-4f09-83d6-050d8d502dbf req-68dfef19-140d-4671-9853-4bd0b0b8ccfa service nova] Creating event network-changed:e47b7859-7c68-4e32-91ab-306cff6c827e for instance 50e42108-979c-426b-8467-f311f9752a06 on hv-cinder-82002 Jan 19 16:16:22.163549 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-51a0d2b5-bc33-4f09-83d6-050d8d502dbf req-68dfef19-140d-4671-9853-4bd0b0b8ccfa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099534 Jan 19 16:16:22.164245 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 760/1443] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:16:22.246637 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-4b0fabce-2802-4e40-bd34-8b377d202801 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23073a05bdd7436eb1cca41b41bf7ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18ab6f6557436981a09d61b4dbdf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:22.256573 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-4b0fabce-2802-4e40-bd34-8b377d202801 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] 10.222.0.58 "GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc" status: 200 len: 1260 microversion: 2.1 time: 0.228998 Jan 19 16:16:22.257148 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 684/1444] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:22 2022] GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:23.274391 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-c910d7e3-9746-4e6d-932d-0d18b99df4fb tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:23.275079 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-c910d7e3-9746-4e6d-932d-0d18b99df4fb tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] [instance: ca130df7-d259-4d74-bdd5-359e571fdbfc] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:23.281751 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c910d7e3-9746-4e6d-932d-0d18b99df4fb tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:23.282185 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c910d7e3-9746-4e6d-932d-0d18b99df4fb tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:23.283123 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c910d7e3-9746-4e6d-932d-0d18b99df4fb tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:23.283552 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-c910d7e3-9746-4e6d-932d-0d18b99df4fb tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:23.445471 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-c910d7e3-9746-4e6d-932d-0d18b99df4fb tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23073a05bdd7436eb1cca41b41bf7ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18ab6f6557436981a09d61b4dbdf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:23.453847 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-c910d7e3-9746-4e6d-932d-0d18b99df4fb tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] 10.222.0.58 "GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc" status: 200 len: 1260 microversion: 2.1 time: 0.183874 Jan 19 16:16:23.457069 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 761/1445] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:23 2022] GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:24.472186 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-79a5a102-e2d7-42d3-954f-084141ddad67 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:24.472789 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-79a5a102-e2d7-42d3-954f-084141ddad67 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] [instance: ca130df7-d259-4d74-bdd5-359e571fdbfc] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:24.478855 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-79a5a102-e2d7-42d3-954f-084141ddad67 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:24.479647 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-79a5a102-e2d7-42d3-954f-084141ddad67 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:24.480090 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-79a5a102-e2d7-42d3-954f-084141ddad67 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:24.480516 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-79a5a102-e2d7-42d3-954f-084141ddad67 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:24.612661 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-79a5a102-e2d7-42d3-954f-084141ddad67 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23073a05bdd7436eb1cca41b41bf7ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18ab6f6557436981a09d61b4dbdf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:24.620076 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-79a5a102-e2d7-42d3-954f-084141ddad67 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] 10.222.0.58 "GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc" status: 200 len: 1260 microversion: 2.1 time: 0.152126 Jan 19 16:16:24.620646 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 685/1446] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:24 2022] GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:24.757449 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-622301fb-38e2-42f1-a9ad-57e24fdee758 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-432855092"}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:16:24.758023 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-622301fb-38e2-42f1-a9ad-57e24fdee758 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:24.764610 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-622301fb-38e2-42f1-a9ad-57e24fdee758 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:24.765553 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-622301fb-38e2-42f1-a9ad-57e24fdee758 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:24.766318 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-622301fb-38e2-42f1-a9ad-57e24fdee758 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:24.766742 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-622301fb-38e2-42f1-a9ad-57e24fdee758 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:24.898551 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.network.security_group_api [None req-622301fb-38e2-42f1-a9ad-57e24fdee758 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Adding security group 806710b5-5222-4a84-bea1-1de19933cb5a to port e47b7859-7c68-4e32-91ab-306cff6c827e Jan 19 16:16:25.336647 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-622301fb-38e2-42f1-a9ad-57e24fdee758 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "POST /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06/action" status: 202 len: 0 microversion: 2.1 time: 0.582998 Jan 19 16:16:25.340882 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 762/1447] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:16:24 2022] POST /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:16:25.345374 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-a04fb05e-41e9-4edc-bafe-dd8b1e41b9e1 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:25.345973 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-a04fb05e-41e9-4edc-bafe-dd8b1e41b9e1 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:25.348376 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-2a5d1330-b90c-499b-aea8-dde86f2f139d req-a2371cfd-2be1-493f-a76c-6c0428222d60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50e42108-979c-426b-8467-f311f9752a06", "tag": "e47b7859-7c68-4e32-91ab-306cff6c827e"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:16:25.350500 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:16:25.350500 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:16:25.358944 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-2a5d1330-b90c-499b-aea8-dde86f2f139d req-a2371cfd-2be1-493f-a76c-6c0428222d60 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:25.359718 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-2a5d1330-b90c-499b-aea8-dde86f2f139d req-a2371cfd-2be1-493f-a76c-6c0428222d60 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:25.364280 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a04fb05e-41e9-4edc-bafe-dd8b1e41b9e1 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:25.364982 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a04fb05e-41e9-4edc-bafe-dd8b1e41b9e1 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:25.366007 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a04fb05e-41e9-4edc-bafe-dd8b1e41b9e1 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:25.366611 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-a04fb05e-41e9-4edc-bafe-dd8b1e41b9e1 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:25.373445 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-2a5d1330-b90c-499b-aea8-dde86f2f139d req-a2371cfd-2be1-493f-a76c-6c0428222d60 service nova] Creating event network-changed:e47b7859-7c68-4e32-91ab-306cff6c827e for instance 50e42108-979c-426b-8467-f311f9752a06 on hv-cinder-82002 Jan 19 16:16:25.379360 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-2a5d1330-b90c-499b-aea8-dde86f2f139d req-a2371cfd-2be1-493f-a76c-6c0428222d60 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034417 Jan 19 16:16:25.380333 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 763/1448] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:16:25.637372 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-08c7bd01-ce70-4ee6-b330-416dac715a2a tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:25.638206 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-08c7bd01-ce70-4ee6-b330-416dac715a2a tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] [instance: ca130df7-d259-4d74-bdd5-359e571fdbfc] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:25.645048 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-08c7bd01-ce70-4ee6-b330-416dac715a2a tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:25.645721 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-08c7bd01-ce70-4ee6-b330-416dac715a2a tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:25.646690 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-08c7bd01-ce70-4ee6-b330-416dac715a2a tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:25.647353 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-08c7bd01-ce70-4ee6-b330-416dac715a2a tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:25.651017 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-a04fb05e-41e9-4edc-bafe-dd8b1e41b9e1 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:25.659580 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-a04fb05e-41e9-4edc-bafe-dd8b1e41b9e1 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1758 microversion: 2.1 time: 0.317594 Jan 19 16:16:25.660789 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 686/1449] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:25 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1758 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:25.789092 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-08c7bd01-ce70-4ee6-b330-416dac715a2a tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23073a05bdd7436eb1cca41b41bf7ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18ab6f6557436981a09d61b4dbdf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:25.797236 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-08c7bd01-ce70-4ee6-b330-416dac715a2a tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] 10.222.0.58 "GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc" status: 200 len: 1260 microversion: 2.1 time: 0.163807 Jan 19 16:16:25.797816 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 764/1450] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:25 2022] GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:16:26.814638 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-795fd718-d7ee-41e8-ab0e-b54668148eb8 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:26.815259 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-795fd718-d7ee-41e8-ab0e-b54668148eb8 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] [instance: ca130df7-d259-4d74-bdd5-359e571fdbfc] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:26.821889 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-795fd718-d7ee-41e8-ab0e-b54668148eb8 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:26.822324 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-795fd718-d7ee-41e8-ab0e-b54668148eb8 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:26.823113 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-795fd718-d7ee-41e8-ab0e-b54668148eb8 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:26.823540 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-795fd718-d7ee-41e8-ab0e-b54668148eb8 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:26.964749 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-795fd718-d7ee-41e8-ab0e-b54668148eb8 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23073a05bdd7436eb1cca41b41bf7ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18ab6f6557436981a09d61b4dbdf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:26.972375 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-795fd718-d7ee-41e8-ab0e-b54668148eb8 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] 10.222.0.58 "GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc" status: 200 len: 1260 microversion: 2.1 time: 0.161923 Jan 19 16:16:26.974268 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 687/1451] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:26 2022] GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:27.989229 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-861fecad-b918-4c47-ac6d-8959a294dbd5 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:27.989799 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-861fecad-b918-4c47-ac6d-8959a294dbd5 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] [instance: ca130df7-d259-4d74-bdd5-359e571fdbfc] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:27.995877 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-861fecad-b918-4c47-ac6d-8959a294dbd5 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:27.996322 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-861fecad-b918-4c47-ac6d-8959a294dbd5 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:27.997096 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-861fecad-b918-4c47-ac6d-8959a294dbd5 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:27.997525 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-861fecad-b918-4c47-ac6d-8959a294dbd5 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:28.130734 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-861fecad-b918-4c47-ac6d-8959a294dbd5 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23073a05bdd7436eb1cca41b41bf7ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18ab6f6557436981a09d61b4dbdf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:28.138153 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-861fecad-b918-4c47-ac6d-8959a294dbd5 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] 10.222.0.58 "GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc" status: 200 len: 1260 microversion: 2.1 time: 0.152704 Jan 19 16:16:28.138740 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 765/1452] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:27 2022] GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:29.155421 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-bad7983f-aa5a-45eb-ba47-2c850a1f62a7 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:29.156129 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-bad7983f-aa5a-45eb-ba47-2c850a1f62a7 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] [instance: ca130df7-d259-4d74-bdd5-359e571fdbfc] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:29.163245 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bad7983f-aa5a-45eb-ba47-2c850a1f62a7 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:29.163684 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bad7983f-aa5a-45eb-ba47-2c850a1f62a7 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:29.164472 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bad7983f-aa5a-45eb-ba47-2c850a1f62a7 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:29.164894 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bad7983f-aa5a-45eb-ba47-2c850a1f62a7 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:29.294106 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-bad7983f-aa5a-45eb-ba47-2c850a1f62a7 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23073a05bdd7436eb1cca41b41bf7ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18ab6f6557436981a09d61b4dbdf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:29.301447 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-bad7983f-aa5a-45eb-ba47-2c850a1f62a7 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] 10.222.0.58 "GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc" status: 200 len: 1260 microversion: 2.1 time: 0.149651 Jan 19 16:16:29.301949 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 688/1453] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:29 2022] GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:30.318495 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-bbc90452-f53a-4df4-b66f-b7ff8bec449d tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:30.319151 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-bbc90452-f53a-4df4-b66f-b7ff8bec449d tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] [instance: ca130df7-d259-4d74-bdd5-359e571fdbfc] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:30.326196 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bbc90452-f53a-4df4-b66f-b7ff8bec449d tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:30.326650 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bbc90452-f53a-4df4-b66f-b7ff8bec449d tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:30.327501 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bbc90452-f53a-4df4-b66f-b7ff8bec449d tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:30.327931 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-bbc90452-f53a-4df4-b66f-b7ff8bec449d tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:30.463328 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-bbc90452-f53a-4df4-b66f-b7ff8bec449d tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23073a05bdd7436eb1cca41b41bf7ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18ab6f6557436981a09d61b4dbdf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:30.471218 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-bbc90452-f53a-4df4-b66f-b7ff8bec449d tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] 10.222.0.58 "GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc" status: 200 len: 1260 microversion: 2.1 time: 0.156396 Jan 19 16:16:30.471786 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 766/1454] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:30 2022] GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:31.489050 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-434f70c3-95cc-422a-b106-ef5343c547b4 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:31.489686 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-434f70c3-95cc-422a-b106-ef5343c547b4 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] [instance: ca130df7-d259-4d74-bdd5-359e571fdbfc] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:31.496402 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-434f70c3-95cc-422a-b106-ef5343c547b4 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:31.496832 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-434f70c3-95cc-422a-b106-ef5343c547b4 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:31.497911 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-434f70c3-95cc-422a-b106-ef5343c547b4 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:31.498344 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-434f70c3-95cc-422a-b106-ef5343c547b4 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:31.634488 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-434f70c3-95cc-422a-b106-ef5343c547b4 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23073a05bdd7436eb1cca41b41bf7ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18ab6f6557436981a09d61b4dbdf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:31.642000 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-434f70c3-95cc-422a-b106-ef5343c547b4 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] 10.222.0.58 "GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc" status: 200 len: 1260 microversion: 2.1 time: 0.157227 Jan 19 16:16:31.642565 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 689/1455] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:31 2022] GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:32.530248 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [req-8169d0d8-c72e-48fa-b24a-643bc026a5f1 req-c90bdb02-f433-4729-a02f-eb2c59f1f0ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca130df7-d259-4d74-bdd5-359e571fdbfc", "name": "network-vif-plugged", "status": "completed", "tag": "429298e6-f280-4ecf-8e87-0f62a06d829c"}]} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:16:32.532379 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:16:32.532379 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: warnings.warn(msg) Jan 19 16:16:32.539670 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-8169d0d8-c72e-48fa-b24a-643bc026a5f1 req-c90bdb02-f433-4729-a02f-eb2c59f1f0ba service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:32.540097 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [req-8169d0d8-c72e-48fa-b24a-643bc026a5f1 req-c90bdb02-f433-4729-a02f-eb2c59f1f0ba service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:32.551505 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.compute.server_external_events [req-8169d0d8-c72e-48fa-b24a-643bc026a5f1 req-c90bdb02-f433-4729-a02f-eb2c59f1f0ba service nova] Creating event network-vif-plugged:429298e6-f280-4ecf-8e87-0f62a06d829c for instance ca130df7-d259-4d74-bdd5-359e571fdbfc on hv-cinder-82002 Jan 19 16:16:32.556739 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [req-8169d0d8-c72e-48fa-b24a-643bc026a5f1 req-c90bdb02-f433-4729-a02f-eb2c59f1f0ba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029814 Jan 19 16:16:32.557447 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 767/1456] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:16:32.659203 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-d1ce20a7-d542-4815-a2d3-c08ba0f24ad6 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:32.660076 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-d1ce20a7-d542-4815-a2d3-c08ba0f24ad6 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] [instance: ca130df7-d259-4d74-bdd5-359e571fdbfc] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:32.666915 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d1ce20a7-d542-4815-a2d3-c08ba0f24ad6 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:32.667465 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d1ce20a7-d542-4815-a2d3-c08ba0f24ad6 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:32.668244 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d1ce20a7-d542-4815-a2d3-c08ba0f24ad6 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:32.668672 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-d1ce20a7-d542-4815-a2d3-c08ba0f24ad6 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:32.832495 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-d1ce20a7-d542-4815-a2d3-c08ba0f24ad6 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23073a05bdd7436eb1cca41b41bf7ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18ab6f6557436981a09d61b4dbdf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:32.842421 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-d1ce20a7-d542-4815-a2d3-c08ba0f24ad6 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] 10.222.0.58 "GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc" status: 200 len: 1260 microversion: 2.1 time: 0.185030 Jan 19 16:16:32.842421 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 690/1457] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:32 2022] GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:33.857047 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-574ad01f-be36-4d67-bfb4-8d80a14d0507 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:33.860336 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-574ad01f-be36-4d67-bfb4-8d80a14d0507 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] [instance: ca130df7-d259-4d74-bdd5-359e571fdbfc] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:33.864408 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-574ad01f-be36-4d67-bfb4-8d80a14d0507 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:33.864846 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-574ad01f-be36-4d67-bfb4-8d80a14d0507 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:33.865606 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-574ad01f-be36-4d67-bfb4-8d80a14d0507 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:33.866029 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-574ad01f-be36-4d67-bfb4-8d80a14d0507 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:33.996303 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-574ad01f-be36-4d67-bfb4-8d80a14d0507 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23073a05bdd7436eb1cca41b41bf7ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18ab6f6557436981a09d61b4dbdf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:34.004437 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-574ad01f-be36-4d67-bfb4-8d80a14d0507 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] 10.222.0.58 "GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc" status: 200 len: 1260 microversion: 2.1 time: 0.151825 Jan 19 16:16:34.005011 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 768/1458] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:33 2022] GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:35.021477 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-bcecdc10-0697-4d8c-85bc-d67cf70b2652 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:35.022040 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-bcecdc10-0697-4d8c-85bc-d67cf70b2652 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] [instance: ca130df7-d259-4d74-bdd5-359e571fdbfc] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:35.028337 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bcecdc10-0697-4d8c-85bc-d67cf70b2652 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:35.028788 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bcecdc10-0697-4d8c-85bc-d67cf70b2652 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:35.029583 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bcecdc10-0697-4d8c-85bc-d67cf70b2652 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:35.030014 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-bcecdc10-0697-4d8c-85bc-d67cf70b2652 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:35.163046 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-bcecdc10-0697-4d8c-85bc-d67cf70b2652 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23073a05bdd7436eb1cca41b41bf7ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18ab6f6557436981a09d61b4dbdf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:35.170658 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-bcecdc10-0697-4d8c-85bc-d67cf70b2652 tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] 10.222.0.58 "GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc" status: 200 len: 1445 microversion: 2.1 time: 0.152961 Jan 19 16:16:35.171280 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 691/1459] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:35 2022] GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:35.187873 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-f65ffa70-ad3f-44cd-8188-2b992ce0791f tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:35.188467 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-f65ffa70-ad3f-44cd-8188-2b992ce0791f tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] [instance: ca130df7-d259-4d74-bdd5-359e571fdbfc] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:16:35.194677 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f65ffa70-ad3f-44cd-8188-2b992ce0791f tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:35.195153 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f65ffa70-ad3f-44cd-8188-2b992ce0791f tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:35.195916 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f65ffa70-ad3f-44cd-8188-2b992ce0791f tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:35.196337 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-f65ffa70-ad3f-44cd-8188-2b992ce0791f tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:35.331446 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-f65ffa70-ad3f-44cd-8188-2b992ce0791f tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23073a05bdd7436eb1cca41b41bf7ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18ab6f6557436981a09d61b4dbdf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:16:35.338934 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-f65ffa70-ad3f-44cd-8188-2b992ce0791f tempest-TestShelveInstance-1279479075 tempest-TestShelveInstance-1279479075-project] 10.222.0.58 "GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc" status: 200 len: 1445 microversion: 2.1 time: 0.155127 Jan 19 16:16:35.339551 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 769/1460] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:16:35 2022] GET /compute/v2.1/servers/ca130df7-d259-4d74-bdd5-359e571fdbfc => generated 1445 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:16:37.341685 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [req-396c056b-36ac-4a3f-ae50-3cb851381f76 req-8903ed17-619f-4f66-8270-df94030f8aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca130df7-d259-4d74-bdd5-359e571fdbfc", "tag": "429298e6-f280-4ecf-8e87-0f62a06d829c"}]} {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:16:37.343346 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:16:37.343346 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: warnings.warn(msg) Jan 19 16:16:37.353788 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-396c056b-36ac-4a3f-ae50-3cb851381f76 req-8903ed17-619f-4f66-8270-df94030f8aa1 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:37.353788 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [req-396c056b-36ac-4a3f-ae50-3cb851381f76 req-8903ed17-619f-4f66-8270-df94030f8aa1 service nova] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:37.365495 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.compute.server_external_events [req-396c056b-36ac-4a3f-ae50-3cb851381f76 req-8903ed17-619f-4f66-8270-df94030f8aa1 service nova] Creating event network-changed:429298e6-f280-4ecf-8e87-0f62a06d829c for instance ca130df7-d259-4d74-bdd5-359e571fdbfc on hv-cinder-82002 Jan 19 16:16:37.371805 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [req-396c056b-36ac-4a3f-ae50-3cb851381f76 req-8903ed17-619f-4f66-8270-df94030f8aa1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034665 Jan 19 16:16:37.373062 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 692/1461] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Jan 19 16:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:17:23.120190 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-aed1fc8a-b778-4fcb-b8d1-5ae540fd6fd4 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:17:23.121124 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-aed1fc8a-b778-4fcb-b8d1-5ae540fd6fd4 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:17:23.127052 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-aed1fc8a-b778-4fcb-b8d1-5ae540fd6fd4 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:23.127494 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-aed1fc8a-b778-4fcb-b8d1-5ae540fd6fd4 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:23.128841 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-aed1fc8a-b778-4fcb-b8d1-5ae540fd6fd4 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:23.129270 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-aed1fc8a-b778-4fcb-b8d1-5ae540fd6fd4 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:23.378334 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-aed1fc8a-b778-4fcb-b8d1-5ae540fd6fd4 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "POST /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06/action" status: 202 len: 0 microversion: 2.1 time: 0.256478 Jan 19 16:17:23.378334 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 770/1462] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Jan 19 16:17:23 2022] POST /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:17:23.383425 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-62243ab2-70a9-4ffc-b757-dfbddb5580ba tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:23.384220 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-62243ab2-70a9-4ffc-b757-dfbddb5580ba tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:17:23.390931 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-62243ab2-70a9-4ffc-b757-dfbddb5580ba tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:23.391433 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-62243ab2-70a9-4ffc-b757-dfbddb5580ba tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:23.392226 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-62243ab2-70a9-4ffc-b757-dfbddb5580ba tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:23.392667 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-62243ab2-70a9-4ffc-b757-dfbddb5580ba tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:23.569052 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-62243ab2-70a9-4ffc-b757-dfbddb5580ba tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:17:23.577240 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-62243ab2-70a9-4ffc-b757-dfbddb5580ba tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1750 microversion: 2.1 time: 0.198398 Jan 19 16:17:23.577828 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 693/1463] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:17:23 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1750 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:17:24.595326 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-24ca889e-3209-45a9-b211-f51e5f791d46 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:24.596030 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-24ca889e-3209-45a9-b211-f51e5f791d46 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:17:24.603184 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-24ca889e-3209-45a9-b211-f51e5f791d46 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:24.603632 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-24ca889e-3209-45a9-b211-f51e5f791d46 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:24.604423 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-24ca889e-3209-45a9-b211-f51e5f791d46 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:24.604855 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-24ca889e-3209-45a9-b211-f51e5f791d46 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:24.826528 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-24ca889e-3209-45a9-b211-f51e5f791d46 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:17:24.835435 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-24ca889e-3209-45a9-b211-f51e5f791d46 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1755 microversion: 2.1 time: 0.244614 Jan 19 16:17:24.836003 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 771/1464] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:17:24 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1755 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:17:25.215072 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:17:25.215660 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: Wed Jan 19 16:17:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 16:17:25.852511 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-e8ba7df0-d0fe-439f-9b0d-d67f8ff42531 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:25.853106 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-e8ba7df0-d0fe-439f-9b0d-d67f8ff42531 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:17:25.859055 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e8ba7df0-d0fe-439f-9b0d-d67f8ff42531 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:25.859477 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e8ba7df0-d0fe-439f-9b0d-d67f8ff42531 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:25.860245 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e8ba7df0-d0fe-439f-9b0d-d67f8ff42531 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:25.860670 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-e8ba7df0-d0fe-439f-9b0d-d67f8ff42531 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:26.001247 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-e8ba7df0-d0fe-439f-9b0d-d67f8ff42531 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:17:26.009567 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-e8ba7df0-d0fe-439f-9b0d-d67f8ff42531 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1755 microversion: 2.1 time: 0.160885 Jan 19 16:17:26.010127 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 694/1465] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:17:25 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:17:27.026199 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-4a028542-4aa5-4a48-a491-9cbdc13efe97 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:27.026882 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-4a028542-4aa5-4a48-a491-9cbdc13efe97 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:17:27.032793 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4a028542-4aa5-4a48-a491-9cbdc13efe97 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:27.033234 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4a028542-4aa5-4a48-a491-9cbdc13efe97 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:27.034010 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4a028542-4aa5-4a48-a491-9cbdc13efe97 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:27.034448 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-4a028542-4aa5-4a48-a491-9cbdc13efe97 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:27.173519 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-4a028542-4aa5-4a48-a491-9cbdc13efe97 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:17:27.182375 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-4a028542-4aa5-4a48-a491-9cbdc13efe97 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1755 microversion: 2.1 time: 0.160002 Jan 19 16:17:27.185829 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 772/1466] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:17:27 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:17:28.199579 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-13c026d6-f6c6-429a-80d0-d4458ef12527 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:28.200202 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-13c026d6-f6c6-429a-80d0-d4458ef12527 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:17:28.206584 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-13c026d6-f6c6-429a-80d0-d4458ef12527 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:28.207054 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-13c026d6-f6c6-429a-80d0-d4458ef12527 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:28.207873 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-13c026d6-f6c6-429a-80d0-d4458ef12527 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:28.208294 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-13c026d6-f6c6-429a-80d0-d4458ef12527 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:28.353710 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-13c026d6-f6c6-429a-80d0-d4458ef12527 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:17:28.361461 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-13c026d6-f6c6-429a-80d0-d4458ef12527 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1755 microversion: 2.1 time: 0.165550 Jan 19 16:17:28.362030 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 695/1467] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:17:28 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:17:29.378503 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-88b445b6-56cc-4137-b514-71089a8bc26e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:29.379134 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-88b445b6-56cc-4137-b514-71089a8bc26e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:17:29.386306 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-88b445b6-56cc-4137-b514-71089a8bc26e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:29.386742 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-88b445b6-56cc-4137-b514-71089a8bc26e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:29.387573 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-88b445b6-56cc-4137-b514-71089a8bc26e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:29.388006 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-88b445b6-56cc-4137-b514-71089a8bc26e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:29.540552 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-88b445b6-56cc-4137-b514-71089a8bc26e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:17:29.548269 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-88b445b6-56cc-4137-b514-71089a8bc26e tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1755 microversion: 2.1 time: 0.173420 Jan 19 16:17:29.548882 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 773/1468] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:17:29 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:17:30.565020 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-11a506fc-4cd4-42a0-a165-8c987a879741 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:30.565616 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-11a506fc-4cd4-42a0-a165-8c987a879741 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:17:30.571796 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-11a506fc-4cd4-42a0-a165-8c987a879741 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:30.572244 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-11a506fc-4cd4-42a0-a165-8c987a879741 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:30.573155 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-11a506fc-4cd4-42a0-a165-8c987a879741 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:30.573756 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-11a506fc-4cd4-42a0-a165-8c987a879741 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:30.724906 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-11a506fc-4cd4-42a0-a165-8c987a879741 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:17:30.733314 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-11a506fc-4cd4-42a0-a165-8c987a879741 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1755 microversion: 2.1 time: 0.171978 Jan 19 16:17:30.733880 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 696/1469] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:17:30 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:17:31.749503 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-8d6e09f9-3587-4734-b946-8854a52349e4 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:31.750088 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-8d6e09f9-3587-4734-b946-8854a52349e4 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:17:31.756440 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8d6e09f9-3587-4734-b946-8854a52349e4 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:31.756885 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8d6e09f9-3587-4734-b946-8854a52349e4 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:31.757663 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8d6e09f9-3587-4734-b946-8854a52349e4 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:31.758088 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-8d6e09f9-3587-4734-b946-8854a52349e4 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:31.896598 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-8d6e09f9-3587-4734-b946-8854a52349e4 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:17:31.904892 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-8d6e09f9-3587-4734-b946-8854a52349e4 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1755 microversion: 2.1 time: 0.159104 Jan 19 16:17:31.905462 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 774/1470] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:17:31 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:17:32.922214 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-1d757670-8294-423c-80df-62e46bc95701 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:32.922760 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-1d757670-8294-423c-80df-62e46bc95701 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:17:32.929090 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1d757670-8294-423c-80df-62e46bc95701 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:32.929415 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1d757670-8294-423c-80df-62e46bc95701 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:32.930176 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1d757670-8294-423c-80df-62e46bc95701 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:32.930598 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-1d757670-8294-423c-80df-62e46bc95701 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:33.076739 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-1d757670-8294-423c-80df-62e46bc95701 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:17:33.084483 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-1d757670-8294-423c-80df-62e46bc95701 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1755 microversion: 2.1 time: 0.166032 Jan 19 16:17:33.085649 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 697/1471] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:17:32 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:17:34.101864 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-24e7a7fc-91e9-4d17-90ba-71ea8b1dbc3c tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:34.102472 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-24e7a7fc-91e9-4d17-90ba-71ea8b1dbc3c tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:17:34.108824 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-24e7a7fc-91e9-4d17-90ba-71ea8b1dbc3c tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:34.109267 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-24e7a7fc-91e9-4d17-90ba-71ea8b1dbc3c tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:34.110038 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-24e7a7fc-91e9-4d17-90ba-71ea8b1dbc3c tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:34.110466 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-24e7a7fc-91e9-4d17-90ba-71ea8b1dbc3c tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:34.253650 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-24e7a7fc-91e9-4d17-90ba-71ea8b1dbc3c tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:17:34.262098 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-24e7a7fc-91e9-4d17-90ba-71ea8b1dbc3c tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1755 microversion: 2.1 time: 0.163918 Jan 19 16:17:34.262668 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 775/1472] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:17:34 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:17:35.278845 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-ca418b80-796e-4d30-a8df-ac057e79aa6f tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:35.279535 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-ca418b80-796e-4d30-a8df-ac057e79aa6f tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:17:35.285695 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ca418b80-796e-4d30-a8df-ac057e79aa6f tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:35.286130 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ca418b80-796e-4d30-a8df-ac057e79aa6f tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:35.286890 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ca418b80-796e-4d30-a8df-ac057e79aa6f tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:35.287345 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-ca418b80-796e-4d30-a8df-ac057e79aa6f tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:35.427499 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-ca418b80-796e-4d30-a8df-ac057e79aa6f tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:17:35.435506 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-ca418b80-796e-4d30-a8df-ac057e79aa6f tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1755 microversion: 2.1 time: 0.160280 Jan 19 16:17:35.436078 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 698/1473] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:17:35 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:17:36.452866 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-a49af379-4f45-449c-8c25-b9890c80c68f tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:36.453456 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-a49af379-4f45-449c-8c25-b9890c80c68f tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:17:36.460292 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a49af379-4f45-449c-8c25-b9890c80c68f tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:36.460729 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a49af379-4f45-449c-8c25-b9890c80c68f tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:36.461493 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a49af379-4f45-449c-8c25-b9890c80c68f tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:36.461919 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-a49af379-4f45-449c-8c25-b9890c80c68f tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:36.603234 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-a49af379-4f45-449c-8c25-b9890c80c68f tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:17:36.611593 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-a49af379-4f45-449c-8c25-b9890c80c68f tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1755 microversion: 2.1 time: 0.162366 Jan 19 16:17:36.617184 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 776/1474] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:17:36 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:17:37.629347 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-cd639c91-d92d-485e-a466-d0a0f3f2bca2 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:37.629951 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-cd639c91-d92d-485e-a466-d0a0f3f2bca2 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:17:37.636721 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cd639c91-d92d-485e-a466-d0a0f3f2bca2 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:37.637161 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cd639c91-d92d-485e-a466-d0a0f3f2bca2 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:37.637924 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cd639c91-d92d-485e-a466-d0a0f3f2bca2 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:37.638354 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-cd639c91-d92d-485e-a466-d0a0f3f2bca2 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:37.873039 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-cd639c91-d92d-485e-a466-d0a0f3f2bca2 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:17:37.880964 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-cd639c91-d92d-485e-a466-d0a0f3f2bca2 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1755 microversion: 2.1 time: 0.255275 Jan 19 16:17:37.882050 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 699/1475] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:17:37 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1755 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:17:38.898493 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.api.openstack.wsgi [None req-5035f4b1-2a12-40c6-a043-609b7ee0195d tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:38.899086 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.compute.api [None req-5035f4b1-2a12-40c6-a043-609b7ee0195d tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128876) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:17:38.905803 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5035f4b1-2a12-40c6-a043-609b7ee0195d tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:38.906243 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5035f4b1-2a12-40c6-a043-609b7ee0195d tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:38.907135 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5035f4b1-2a12-40c6-a043-609b7ee0195d tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:38.907566 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG oslo_concurrency.lockutils [None req-5035f4b1-2a12-40c6-a043-609b7ee0195d tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:39.056336 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: DEBUG nova.policy [None req-5035f4b1-2a12-40c6-a043-609b7ee0195d tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128876) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:17:39.065026 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO nova.api.openstack.requestlog [None req-5035f4b1-2a12-40c6-a043-609b7ee0195d tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1755 microversion: 2.1 time: 0.170169 Jan 19 16:17:39.065620 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: [pid: 128876|app: 0|req: 777/1476] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:17:38 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:17:40.085476 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.api.openstack.wsgi [None req-54e40435-e383-4c8b-9e33-b3eda20f6d84 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Calling method '>' {{(pid=128875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:40.086108 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.compute.api [None req-54e40435-e383-4c8b-9e33-b3eda20f6d84 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] [instance: 50e42108-979c-426b-8467-f311f9752a06] Fetching instance by UUID {{(pid=128875) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:17:40.092981 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-54e40435-e383-4c8b-9e33-b3eda20f6d84 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:40.093446 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-54e40435-e383-4c8b-9e33-b3eda20f6d84 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:40.094214 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-54e40435-e383-4c8b-9e33-b3eda20f6d84 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:17:40.094641 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG oslo_concurrency.lockutils [None req-54e40435-e383-4c8b-9e33-b3eda20f6d84 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Lock "753ba822-f6b2-435f-a99e-73d7149d7f8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:17:40.238357 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: DEBUG nova.policy [None req-54e40435-e383-4c8b-9e33-b3eda20f6d84 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3382a2439db46fb871bc50f6a5d8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175793bce6734cf6872bf073411a135d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128875) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:17:40.247136 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO nova.api.openstack.requestlog [None req-54e40435-e383-4c8b-9e33-b3eda20f6d84 tempest-TestMinimumBasicScenario-846392250 tempest-TestMinimumBasicScenario-846392250-project] 10.222.0.58 "GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06" status: 200 len: 1758 microversion: 2.1 time: 0.165161 Jan 19 16:17:40.247807 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: [pid: 128875|app: 0|req: 700/1477] 10.222.0.58 () {58 vars in 1235 bytes} [Wed Jan 19 16:17:40 2022] GET /compute/v2.1/servers/50e42108-979c-426b-8467-f311f9752a06 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:19:05.249878 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:19:05.250524 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: Wed Jan 19 16:19:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 16:19:30.251805 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:19:30.252465 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: Wed Jan 19 16:19:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 16:20:45.223382 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:20:45.224769 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: Wed Jan 19 16:20:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 16:20:50.578716 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:20:50.579444 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: Wed Jan 19 16:20:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 16:20:53.957942 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:20:53.959158 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: Wed Jan 19 16:20:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 16:22:25.258271 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:22:25.265697 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: Wed Jan 19 16:22:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 16:22:47.104285 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:22:47.105032 dv-cinder-820027-5-iscsi devstack@n-api.service[128876]: Wed Jan 19 16:22:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 16:22:50.260013 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:22:50.260694 dv-cinder-820027-5-iscsi devstack@n-api.service[128875]: Wed Jan 19 16:22:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!